Apr 14 14:10:36 user devstack@n-api.service[61715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 14:10:36 user devstack@n-api.service[61715]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 14:10:36 2023] *** Apr 14 14:10:36 user devstack@n-api.service[61715]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 14:10:36 user devstack@n-api.service[61715]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 14:10:36 user devstack@n-api.service[61715]: nodename: user Apr 14 14:10:36 user devstack@n-api.service[61715]: machine: x86_64 Apr 14 14:10:36 user devstack@n-api.service[61715]: clock source: unix Apr 14 14:10:36 user devstack@n-api.service[61715]: pcre jit disabled Apr 14 14:10:36 user devstack@n-api.service[61715]: detected number of CPU cores: 12 Apr 14 14:10:36 user devstack@n-api.service[61715]: current working directory: / Apr 14 14:10:36 user devstack@n-api.service[61715]: detected binary path: /usr/bin/uwsgi-core Apr 14 14:10:36 user devstack@n-api.service[61715]: your processes number limit is 63637 Apr 14 14:10:36 user devstack@n-api.service[61715]: your memory page size is 4096 bytes Apr 14 14:10:36 user devstack@n-api.service[61715]: detected max file descriptor number: 2048 Apr 14 14:10:36 user devstack@n-api.service[61715]: lock engine: pthread robust mutexes Apr 14 14:10:36 user devstack@n-api.service[61715]: thunder lock: enabled Apr 14 14:10:36 user devstack@n-api.service[61715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 14:10:36 user devstack@n-api.service[61715]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 14:10:36 user devstack@n-api.service[61715]: Python main interpreter initialized at 0x559c74ba7990 Apr 14 14:10:36 user devstack@n-api.service[61715]: python threads support enabled Apr 14 14:10:36 user devstack@n-api.service[61715]: your server socket listen backlog is limited to 100 connections Apr 14 14:10:36 user devstack@n-api.service[61715]: your mercy for graceful operations on workers is 90 seconds Apr 14 14:10:36 user devstack@n-api.service[61715]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 14:10:36 user devstack@n-api.service[61715]: *** Operational MODE: preforking *** Apr 14 14:10:36 user devstack@n-api.service[61715]: *** uWSGI is running in multiple interpreter mode *** Apr 14 14:10:36 user devstack@n-api.service[61715]: spawned uWSGI master process (pid: 61715) Apr 14 14:10:36 user devstack@n-api.service[61715]: spawned uWSGI worker 1 (pid: 61716, cores: 1) Apr 14 14:10:36 user devstack@n-api.service[61715]: spawned uWSGI worker 2 (pid: 61717, cores: 1) Apr 14 14:10:36 user devstack@n-api.service[61715]: spawned uWSGI worker 3 (pid: 61718, cores: 1) Apr 14 14:10:36 user devstack@n-api.service[61715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 14:10:37 user devstack@n-api.service[61718]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 14:10:37 user devstack@n-api.service[61717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 14:10:37 user devstack@n-api.service[61716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 14:10:40 user devstack@n-api.service[61718]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 14:10:40 user devstack@n-api.service[61718]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 14:10:40 user devstack@n-api.service[61718]: and ``live_migration_inbound_addr`` respectively. Apr 14 14:10:40 user devstack@n-api.service[61718]: ). Its value may be silently ignored in the future. Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 14:10:40 user devstack@n-api.service[61717]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 14:10:40 user devstack@n-api.service[61717]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 14:10:40 user devstack@n-api.service[61717]: and ``live_migration_inbound_addr`` respectively. Apr 14 14:10:40 user devstack@n-api.service[61717]: ). Its value may be silently ignored in the future. Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61718) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 14:10:40 user devstack@n-api.service[61716]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 14:10:40 user devstack@n-api.service[61716]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 14:10:40 user devstack@n-api.service[61716]: and ``live_migration_inbound_addr`` respectively. Apr 14 14:10:40 user devstack@n-api.service[61716]: ). Its value may be silently ignored in the future. Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61717) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: INFO dbcounter [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Registered counter for database nova_api Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61718) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writer thread running {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61716) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 14:10:40 user devstack@n-api.service[61717]: INFO dbcounter [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Registered counter for database nova_api Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG nova.context [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e9f1617-03cf-4856-8f56-6b332827f1da(cell1) {{(pid=61718) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:10:40 user devstack@n-api.service[61718]: INFO dbcounter [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Registered counter for database nova_cell0 Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_db.sqlalchemy.engines [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61717) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61718]: INFO dbcounter [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Registered counter for database nova_cell1 Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61718) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writer thread running {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writer thread running {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61716]: INFO dbcounter [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Registered counter for database nova_api Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61716) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writer thread running {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG nova.context [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e9f1617-03cf-4856-8f56-6b332827f1da(cell1) {{(pid=61717) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:10:40 user devstack@n-api.service[61717]: INFO dbcounter [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Registered counter for database nova_cell0 Apr 14 14:10:40 user devstack@n-api.service[61717]: INFO dbcounter [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Registered counter for database nova_cell1 Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG nova.context [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e9f1617-03cf-4856-8f56-6b332827f1da(cell1) {{(pid=61716) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_db.sqlalchemy.engines [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61717) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writer thread running {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:10:40 user devstack@n-api.service[61717]: DEBUG oslo_db.sqlalchemy.engines [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61717) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61716]: INFO dbcounter [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Registered counter for database nova_cell0 Apr 14 14:10:40 user devstack@n-api.service[61716]: INFO dbcounter [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Registered counter for database nova_cell1 Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61718) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61716) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writer thread running {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writer thread running {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:40 user devstack@n-api.service[61716]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61716) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61718]: INFO dbcounter [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Registered counter for database nova_cell0 Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG oslo_db.sqlalchemy.engines [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61718) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:40 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writer thread running {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:41 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writer thread running {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:41 user devstack@n-api.service[61717]: INFO dbcounter [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Registered counter for database nova_cell0 Apr 14 14:10:41 user devstack@n-api.service[61717]: DEBUG oslo_db.sqlalchemy.engines [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61717) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:41 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writer thread running {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:41 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writer thread running {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:41 user devstack@n-api.service[61716]: INFO dbcounter [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Registered counter for database nova_cell0 Apr 14 14:10:41 user devstack@n-api.service[61716]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61716) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 14:10:41 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writer thread running {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 14:10:41 user devstack@n-api.service[61718]: WARNING keystonemiddleware.auth_token [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 14:10:41 user devstack@n-api.service[61718]: WARNING keystonemiddleware.auth_token [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 14:10:41 user devstack@n-api.service[61716]: WARNING keystonemiddleware.auth_token [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 14:10:41 user devstack@n-api.service[61716]: WARNING keystonemiddleware.auth_token [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 14:10:41 user devstack@n-api.service[61718]: WARNING keystonemiddleware.auth_token [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 14:10:41 user devstack@n-api.service[61718]: WARNING keystonemiddleware.auth_token [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 14:10:41 user devstack@n-api.service[61718]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c74ba7990 pid: 61718 (default app) Apr 14 14:10:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:10:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001452 Apr 14 14:10:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 14:10:41 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:10:41 user devstack@n-api.service[61717]: WARNING keystonemiddleware.auth_token [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 14:10:41 user devstack@n-api.service[61717]: WARNING keystonemiddleware.auth_token [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 14:10:41 user devstack@n-api.service[61716]: WARNING keystonemiddleware.auth_token [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 14:10:41 user devstack@n-api.service[61716]: WARNING keystonemiddleware.auth_token [None req-1c0ef7e2-af32-4c60-b534-db5647f9e0ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 14:10:41 user devstack@n-api.service[61716]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c74ba7990 pid: 61716 (default app) Apr 14 14:10:41 user devstack@n-api.service[61717]: WARNING keystonemiddleware.auth_token [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 14:10:41 user devstack@n-api.service[61717]: WARNING keystonemiddleware.auth_token [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 14:10:41 user devstack@n-api.service[61717]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c74ba7990 pid: 61717 (default app) Apr 14 14:12:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:12:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e6e6ea38-21fd-4b01-9a81-8f71d8dbb317 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001606 Apr 14 14:12:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:12:51 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:12:51 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:51 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:51 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:51 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-eb1e27f4-884c-46f4-83f3-cb46bf7ec42a admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:12:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-eb1e27f4-884c-46f4-83f3-cb46bf7ec42a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.393314 Apr 14 14:12:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 14:12:51 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:12:53 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:12:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.004624 Apr 14 14:12:53 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:12:53 2023] GET /compute/v2.1 => generated 387 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:12:53 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:53 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:53 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:53 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:12:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5ca2b5ff-8642-4faa-bc3d-c5ad9258c77e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 256, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5ca2b5ff-8642-4faa-bc3d-c5ad9258c77e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.308645 Apr 14 14:12:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:12:53 2023] POST /compute/v2.1/flavors => generated 405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:12:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1b2e4c3e-5c07-42b3-a44d-1b4f2c49e86a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1b2e4c3e-5c07-42b3-a44d-1b4f2c49e86a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045606 Apr 14 14:12:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 14:12:53 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:12:55 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:12:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001264 Apr 14 14:12:55 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:12:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:12:55 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-39033dc8-4e17-4c5e-b7c8-ce671f16a7fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "id": "d1"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-39033dc8-4e17-4c5e-b7c8-ce671f16a7fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080814 Apr 14 14:12:55 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:12:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:12:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8420192e-8118-4945-b1b0-5ac5e1cf8caf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8420192e-8118-4945-b1b0-5ac5e1cf8caf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029128 Apr 14 14:12:55 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 14:12:55 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:12:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:12:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001348 Apr 14 14:12:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:12:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:12:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b1c53d5d-1048-42e7-956b-f5446ab994ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b1c53d5d-1048-42e7-956b-f5446ab994ab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065590 Apr 14 14:12:57 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:12:57 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:12:57 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-9b355933-60f4-4d1d-8484-c777c98e56f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-9b355933-60f4-4d1d-8484-c777c98e56f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029227 Apr 14 14:12:57 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 14:12:57 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:12:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:12:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002059 Apr 14 14:12:59 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:12:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:12:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8da50916-c17c-4d0b-b376-4a490394b931 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "vcpus": 2}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8da50916-c17c-4d0b-b376-4a490394b931 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084886 Apr 14 14:12:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:12:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:12:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-73e09f49-ff52-45e4-8c1b-e5c804a88ba6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:12:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-73e09f49-ff52-45e4-8c1b-e5c804a88ba6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041099 Apr 14 14:12:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 14:12:59 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001398 Apr 14 14:13:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2ecfff7f-f485-43aa-8b07-7b0aaaaa3efc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "id": "d4", "vcpus": 4, "swap": 0}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2ecfff7f-f485-43aa-8b07-7b0aaaaa3efc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057583 Apr 14 14:13:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:13:01 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:13:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023525 Apr 14 14:13:01 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 14:13:01 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:03 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5dab5269-4570-4816-b1db-fdfdda69b25d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001439 Apr 14 14:13:03 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-19ffcdac-f5d3-4b23-a951-4f06a2046326 admin admin] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-19ffcdac-f5d3-4b23-a951-4f06a2046326 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.081981 Apr 14 14:13:03 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 14:13:03 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:13:05 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:05 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001557 Apr 14 14:13:05 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:05 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:05 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:13:05 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:13:05 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:13:05 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:13:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d3b4d4f0-5b35-4243-94e4-4ce098a6430c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d3b4d4f0-5b35-4243-94e4-4ce098a6430c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.355268 Apr 14 14:13:06 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:13:05 2023] POST /compute/v2.1/flavors => generated 400 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:13:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2bbff76e-97fd-4ea9-8d0c-271ef6567fb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2bbff76e-97fd-4ea9-8d0c-271ef6567fb9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053690 Apr 14 14:13:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 14:13:06 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:08 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001298 Apr 14 14:13:08 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-59407fc6-888b-4cb1-acdd-0e224c972d0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "swap": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-59407fc6-888b-4cb1-acdd-0e224c972d0a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063556 Apr 14 14:13:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:13:08 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:13:08 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1749e765-d705-431c-9fac-4b39d3a0a1d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1749e765-d705-431c-9fac-4b39d3a0a1d4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036186 Apr 14 14:13:08 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 14:13:08 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001459 Apr 14 14:13:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ad724cdb-1571-420d-8b1b-a2a337316221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ad724cdb-1571-420d-8b1b-a2a337316221 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.062900 Apr 14 14:13:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:13:10 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:13:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-567c7897-fbfd-4df2-b3f6-a71631f76f46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-567c7897-fbfd-4df2-b3f6-a71631f76f46 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024114 Apr 14 14:13:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 14:13:10 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:12 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002104 Apr 14 14:13:12 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:12 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:12 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f3e1347d-bc89-4837-8c72-b31680913680 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f3e1347d-bc89-4837-8c72-b31680913680 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.092199 Apr 14 14:13:12 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:13:12 2023] POST /compute/v2.1/flavors => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:13:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a18e8b54-893a-47ee-82f9-2a37a0af7c30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a18e8b54-893a-47ee-82f9-2a37a0af7c30 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023937 Apr 14 14:13:12 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 14:13:12 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:14 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001404 Apr 14 14:13:14 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 14:13:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8ca95617-64fc-4a68-8ba3-42e37d3975b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8ca95617-64fc-4a68-8ba3-42e37d3975b8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059016 Apr 14 14:13:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 14:13:14 2023] POST /compute/v2.1/flavors => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:13:14 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1efc22da-f5c9-4d2e-b2d9-aaaaef8fe9b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:13:14 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1efc22da-f5c9-4d2e-b2d9-aaaaef8fe9b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026393 Apr 14 14:13:14 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 14:13:14 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:13:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-088ce9ff-ddf7-4faf-9a44-4edd82b3a66d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001532 Apr 14 14:13:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 14:13:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:13:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:13:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.101496 Apr 14 14:13:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 14:13:46 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:14:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1efc22da-f5c9-4d2e-b2d9-aaaaef8fe9b7 admin admin] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:14:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1efc22da-f5c9-4d2e-b2d9-aaaaef8fe9b7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001509 Apr 14 14:14:17 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 14:14:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:14:17 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:14:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-28c116c0-a821-4aac-973b-0376f538b806 admin admin] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:14:17 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-28c116c0-a821-4aac-973b-0376f538b806 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.071386 Apr 14 14:14:17 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 14:14:17 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:14:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:14:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002599 Apr 14 14:14:21 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 14:14:21 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:14:21 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:14:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-acd92953-8169-4448-b637-c65f4f7b5a82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "m1.nano", "id": "42", "vcpus": 1, "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:14:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-acd92953-8169-4448-b637-c65f4f7b5a82 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061620 Apr 14 14:14:21 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 14:14:21 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:14:21 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7673a603-9ad6-4310-8c9f-6f80870077c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:14:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7673a603-9ad6-4310-8c9f-6f80870077c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025666 Apr 14 14:14:21 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 14:14:21 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:14:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:14:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d3f1116f-e6b0-4343-8b34-76d6e7cffd58 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001477 Apr 14 14:14:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 14:14:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:14:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c3e980e1-58fc-40a1-913d-7f9b5d935c7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "84", "ram": 192, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:14:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c3e980e1-58fc-40a1-913d-7f9b5d935c7f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063243 Apr 14 14:14:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 14:14:26 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:14:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4c963219-66f0-42b2-956f-93f786e7d2ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:14:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4c963219-66f0-42b2-956f-93f786e7d2ca admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026836 Apr 14 14:14:26 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 14:14:26 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:16:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:16:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:16:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:16:55 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-667599017", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:16:55 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] validate_networks() for [('ad43cdc7-07dc-4fda-bc56-3290a2d03c80', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for project b53efd997e3e47d898264dae8a27a5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:16:57 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for user cdfcb787b0f545f8b19e947d54d07b9c and project b53efd997e3e47d898264dae8a27a5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:16:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:16:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:16:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.587916 Apr 14 14:16:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:16:55 2023] POST /compute/v2.1/servers => generated 381 bytes in 2589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:16:58 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:16:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-196bcb44-cb1b-42c7-86c5-9027c1c2b6ca tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:16:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-196bcb44-cb1b-42c7-86c5-9027c1c2b6ca tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:16:58 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-196bcb44-cb1b-42c7-86c5-9027c1c2b6ca tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:16:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-196bcb44-cb1b-42c7-86c5-9027c1c2b6ca tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1215 microversion: 2.1 time: 0.314136 Apr 14 14:16:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:16:58 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:16:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:16:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1496827", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:16:58 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] validate_networks() for [('ad43cdc7-07dc-4fda-bc56-3290a2d03c80', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:16:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1210991027", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "47bbc824-8196-42ee-a900-6160879c338b"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:16:59 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] validate_networks() for [('47bbc824-8196-42ee-a900-6160879c338b', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:16:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5993be28-9b31-4189-af29-c71c79eb0d41 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'create', calling method: .version_select at 0x7f67e4f97f40>, body: {"keypair": {"name": "tempest-keypair-220938053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:16:59 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-5993be28-9b31-4189-af29-c71c79eb0d41 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:16:59 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-5993be28-9b31-4189-af29-c71c79eb0d41 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:16:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5993be28-9b31-4189-af29-c71c79eb0d41 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143792 Apr 14 14:16:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 18/48] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:16:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for project b53efd997e3e47d898264dae8a27a5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for user cdfcb787b0f545f8b19e947d54d07b9c and project b53efd997e3e47d898264dae8a27a5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.425139 Apr 14 14:17:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:16:58 2023] POST /compute/v2.1/servers => generated 381 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b5d039c6-46f9-4c82-8983-cc64ab42b16b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b5d039c6-46f9-4c82-8983-cc64ab42b16b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-b5d039c6-46f9-4c82-8983-cc64ab42b16b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b5d039c6-46f9-4c82-8983-cc64ab42b16b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 200 len: 1213 microversion: 2.1 time: 0.196844 Apr 14 14:17:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 19/50] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:00 2023] GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Getting quotas for project b3e71e69f67a4c44be53fa655a7b50e5. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Getting quotas for user f6a767acbdff4f65bef46f45d0c745f7 and project b3e71e69f67a4c44be53fa655a7b50e5. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:02 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.392370 Apr 14 14:17:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 16/51] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:16:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 3394 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e8ddd7a9-0a6e-4226-8ac4-ceb57ed9f29f tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e8ddd7a9-0a6e-4226-8ac4-ceb57ed9f29f tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:02 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e8ddd7a9-0a6e-4226-8ac4-ceb57ed9f29f tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a767acbdff4f65bef46f45d0c745f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e71e69f67a4c44be53fa655a7b50e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e8ddd7a9-0a6e-4226-8ac4-ceb57ed9f29f tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" status: 200 len: 1208 microversion: 2.1 time: 0.369925 Apr 14 14:17:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:02 2023] GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => generated 1208 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2047783908", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:05 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] validate_networks() for [('6dbfb18b-1c4c-42fe-8597-3b57e05446a2', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-178100452", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3d9490f5-8130-426e-9126-f2edafc77fbe"}], "security_groups": [{"name": "tempest-securitygroup--1851558202"}], "key_name": "tempest-keypair-220938053", "user_data": "}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Getting quotas for project 08dbbd3691924823b98d44b11508019e. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Getting quotas for user a609ae82102a4ec994823e59f1a37378 and project 08dbbd3691924823b98d44b11508019e. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:07 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] validate_networks() for [('3d9490f5-8130-426e-9126-f2edafc77fbe', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:07 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.800905 Apr 14 14:17:07 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 20/53] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:17:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 2805 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d1f82c47-2a4b-4ff7-a130-ae4403e2861f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:07 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-d1f82c47-2a4b-4ff7-a130-ae4403e2861f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:07 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-d1f82c47-2a4b-4ff7-a130-ae4403e2861f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d1f82c47-2a4b-4ff7-a130-ae4403e2861f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1211 microversion: 2.1 time: 0.211174 Apr 14 14:17:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:07 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1211 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Creating event network-changed:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61718) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61718) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:08 user devstack@n-api.service[61718]: INFO nova.compute.rpcapi [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 14:17:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] Releasing lock "compute-rpcapi-router" {{(pid=61718) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 14:17:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2314a3a5-44a1-4d9c-9766-1cc68f589c6b None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142204 Apr 14 14:17:08 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 21/55] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:09 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Creating event network-changed:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61716) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61716) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:10 user devstack@n-api.service[61716]: INFO nova.compute.rpcapi [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 14:17:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] Releasing lock "compute-rpcapi-router" {{(pid=61716) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 14:17:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-deed8e0a-848d-4476-84a0-f99b2ea21ad5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120203 Apr 14 14:17:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 19/56] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:11 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.530419 Apr 14 14:17:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 17/57] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:17:07 2023] POST /compute/v2.1/servers => generated 407 bytes in 4532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f3269fc2-8c6f-41f7-986d-abd099e73b29 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:11 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f3269fc2-8c6f-41f7-986d-abd099e73b29 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:11 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f3269fc2-8c6f-41f7-986d-abd099e73b29 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f3269fc2-8c6f-41f7-986d-abd099e73b29 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1231 microversion: 2.1 time: 0.205605 Apr 14 14:17:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 22/58] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:11 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1231 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:12 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-85a5f7b9-cbb4-43f5-9262-ba41bc70953b tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'create', calling method: .version_select at 0x7f67e452add0>, body: {"keypair": {"name": "tempest-keypair-394852903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtFgmxFsC73JI3EOJh01Vi6JhjHyCGpGBiOSuQtkbj5LzuB0w3biqviCjGuFN4y4RXRWYVOA71m7CX2sS0tv+XOQaF5SvRG09bebHIKCIKlHl28aGGTIvcDfXJMO71mjA=="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:12 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-85a5f7b9-cbb4-43f5-9262-ba41bc70953b tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for project b8263321b4e34ea08350e97ac2a3a794. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:12 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-85a5f7b9-cbb4-43f5-9262-ba41bc70953b tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for user a7a99d9a44334bfeb39f6684853f6844 and project b8263321b4e34ea08350e97ac2a3a794. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-85a5f7b9-cbb4-43f5-9262-ba41bc70953b tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.135337 Apr 14 14:17:12 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 20/59] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 14:17:12 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4", "tag": "03114745-3adc-4f7e-b3e5-6623abee6e40"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Creating event network-changed:03114745-3adc-4f7e-b3e5-6623abee6e40 for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 on user Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61717) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Acquired lock "compute-rpcapi-router" {{(pid=61717) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:13 user devstack@n-api.service[61717]: INFO nova.compute.rpcapi [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 14:17:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] Releasing lock "compute-rpcapi-router" {{(pid=61717) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 14:17:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2c4d80e7-7288-48b1-87ff-dbc4d35cbd72 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141661 Apr 14 14:17:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 18/60] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1709371088", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:13 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] validate_networks() for [('10c13d5f-fce7-4ec7-a3a3-82927a3d1185', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:14 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Creating event network-vif-plugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:17:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085370 Apr 14 14:17:14 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Getting quotas for project 4ec387d0522a482998dc856bf579d1af. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Getting quotas for user 43e27123c26e416a8d024d4029249f4b and project 4ec387d0522a482998dc856bf579d1af. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:15 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.370335 Apr 14 14:17:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 23/62] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:17:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:15 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-746a11ea-0711-4244-b21c-881fc8632793 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:15 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-746a11ea-0711-4244-b21c-881fc8632793 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:15 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-746a11ea-0711-4244-b21c-881fc8632793 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e27123c26e416a8d024d4029249f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec387d0522a482998dc856bf579d1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-746a11ea-0711-4244-b21c-881fc8632793 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 200 len: 1209 microversion: 2.1 time: 0.150203 Apr 14 14:17:15 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 19/63] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:15 2023] GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 1209 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:16 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}, {"name": "network-changed", "server_uuid": "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8", "tag": "af22d0f9-f6de-4604-90f0-833f831a7a37"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Creating event network-vif-plugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:17:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Creating event network-changed:af22d0f9-f6de-4604-90f0-833f831a7a37 for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 on user Apr 14 14:17:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043559 Apr 14 14:17:16 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:16 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:17:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 Apr 14 14:17:17 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 24/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:19 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:17:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042315 Apr 14 14:17:19 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 20/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:20 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1743182580", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e0719d7f-e55b-4c63-91f9-8feef7bd3905"}], "security_groups": [{"name": "tempest-securitygroup--716173642"}], "key_name": "tempest-keypair-394852903", "user_data": "}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:20 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:20 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] validate_networks() for [('e0719d7f-e55b-4c63-91f9-8feef7bd3905', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4", "name": "network-vif-plugged", "status": "completed", "tag": "03114745-3adc-4f7e-b3e5-6623abee6e40"}, {"server_uuid": "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4", "name": "network-vif-plugged", "status": "completed", "tag": "03114745-3adc-4f7e-b3e5-6623abee6e40"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Creating event network-vif-plugged:03114745-3adc-4f7e-b3e5-6623abee6e40 for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 on user Apr 14 14:17:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Creating event network-vif-plugged:03114745-3adc-4f7e-b3e5-6623abee6e40 for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 on user Apr 14 14:17:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075153 Apr 14 14:17:21 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 25/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=14 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for project b8263321b4e34ea08350e97ac2a3a794. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for user a7a99d9a44334bfeb39f6684853f6844 and project b8263321b4e34ea08350e97ac2a3a794. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 2.156190 Apr 14 14:17:22 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 23/68] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:17:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:17:22 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8cc39c00-22f2-4e8c-b58c-c1607147e6f9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:22 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8cc39c00-22f2-4e8c-b58c-c1607147e6f9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:22 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-8cc39c00-22f2-4e8c-b58c-c1607147e6f9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:22 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-8cc39c00-22f2-4e8c-b58c-c1607147e6f9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:22 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-8cc39c00-22f2-4e8c-b58c-c1607147e6f9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:22 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8cc39c00-22f2-4e8c-b58c-c1607147e6f9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1275 microversion: 2.20 time: 0.492784 Apr 14 14:17:22 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 21/69] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:17:22 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:17:23 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}, {"server_uuid": "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "af22d0f9-f6de-4604-90f0-833f831a7a37"}, {"server_uuid": "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "af22d0f9-f6de-4604-90f0-833f831a7a37"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:23 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:23 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:23 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Creating event network-changed:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:17:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Creating event network-vif-plugged:af22d0f9-f6de-4604-90f0-833f831a7a37 for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 on user Apr 14 14:17:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Creating event network-vif-plugged:af22d0f9-f6de-4604-90f0-833f831a7a37 for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 on user Apr 14 14:17:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.141759 Apr 14 14:17:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 26/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8466c697-f5b2-4e1a-ad03-b97ea7bbd496 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Action: 'create', calling method: .version_select at 0x7f67e45813f0>, body: {"keypair": {"name": "tempest-keypair-706581506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQjfgmzxezY/KHcd5PdM3vkmvQnoAgqCZxGXXY6YTcu6O1yAZ/H9Mco+AeVrFCASW4ysVKsiv7y+LJXoAzQa4DW0tB/Tt/+WW7OwCivZK7OhQt19fhtQAO7wQJzSLFMQg=="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:24 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-8466c697-f5b2-4e1a-ad03-b97ea7bbd496 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting quotas for project aa21be0383ba4cab992ec2b897e763f4. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:24 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-8466c697-f5b2-4e1a-ad03-b97ea7bbd496 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting quotas for user e5c31630bdcb497da65f928490c26948 and project aa21be0383ba4cab992ec2b897e763f4. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8466c697-f5b2-4e1a-ad03-b97ea7bbd496 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.500396 Apr 14 14:17:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:17:24 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:17:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06baebb6-4922-4d82-b396-48bf76c60f2d", "tag": "1ec51781-92ba-45d2-9635-5aa1c6cf918a"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=9 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=13 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Creating event network-changed:1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance 06baebb6-4922-4d82-b396-48bf76c60f2d on user Apr 14 14:17:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099424 Apr 14 14:17:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 22/72] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:26 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:26 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=22 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:17:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044203 Apr 14 14:17:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 27/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:28 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=13 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:17:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059916 Apr 14 14:17:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0ebed7ee-40f1-43b5-acec-8cb3082c4021 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Action: 'create', calling method: .version_select at 0x7f67e452dc60>, body: {"keypair": {"name": "tempest-keypair-557766472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUHjZA/lLKTL8AYeb4MKZeMNC7337OmlBs6hgJc5vFrxuDLxwaaWgDr+nofdCoAuOjgQLOS5xfkD17Ozje4oKBUcPsZO+KEmoUYKmHrqoxiWCDi8m4XdobKcM0hp08pXg=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=23 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:28 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-0ebed7ee-40f1-43b5-acec-8cb3082c4021 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Getting quotas for project aab9855c5aa444fb8c1636fda0b2f394. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:28 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-0ebed7ee-40f1-43b5-acec-8cb3082c4021 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Getting quotas for user d54c4c3585e74670adcb025cf9331844 and project aab9855c5aa444fb8c1636fda0b2f394. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0ebed7ee-40f1-43b5-acec-8cb3082c4021 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157323 Apr 14 14:17:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 23/75] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:17:28 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:30 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:30 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:30 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=17 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Creating event network-changed:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:17:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055348 Apr 14 14:17:30 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 28/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:33 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1556722134", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "40223427-597e-4817-ab9c-7e8119692b79"}], "security_groups": [{"name": "tempest-securitygroup--1824175225"}], "key_name": "tempest-keypair-706581506", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:33 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] validate_networks() for [('40223427-597e-4817-ab9c-7e8119692b79', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06baebb6-4922-4d82-b396-48bf76c60f2d", "name": "network-vif-plugged", "status": "completed", "tag": "1ec51781-92ba-45d2-9635-5aa1c6cf918a"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Creating event network-vif-plugged:1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance 06baebb6-4922-4d82-b396-48bf76c60f2d on user Apr 14 14:17:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073977 Apr 14 14:17:33 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 24/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:34 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-plugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:34 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Creating event network-vif-plugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:17:34 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065444 Apr 14 14:17:34 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 29/78] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:34 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06baebb6-4922-4d82-b396-48bf76c60f2d", "name": "network-vif-plugged", "status": "completed", "tag": "1ec51781-92ba-45d2-9635-5aa1c6cf918a"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting quotas for project aa21be0383ba4cab992ec2b897e763f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting quotas for user e5c31630bdcb497da65f928490c26948 and project aa21be0383ba4cab992ec2b897e763f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:36 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Creating event network-vif-plugged:1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance 06baebb6-4922-4d82-b396-48bf76c60f2d on user Apr 14 14:17:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075701 Apr 14 14:17:36 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 25/79] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:36 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.276366 Apr 14 14:17:36 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:17:33 2023] POST /compute/v2.1/servers => generated 404 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-70f7d9d0-d12b-418e-b91b-11433b1eb2f4 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:36 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-70f7d9d0-d12b-418e-b91b-11433b1eb2f4 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:36 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-70f7d9d0-d12b-418e-b91b-11433b1eb2f4 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-70f7d9d0-d12b-418e-b91b-11433b1eb2f4 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e" status: 200 len: 1235 microversion: 2.1 time: 0.146227 Apr 14 14:17:36 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 30/81] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:36 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e => generated 1235 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-plugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Creating event network-vif-plugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:17:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058169 Apr 14 14:17:36 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 26/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1181707762", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "02d90be5-47ba-45f5-b49d-60de28b6639c"}], "security_groups": [{"name": "tempest-securitygroup--1790421462"}], "key_name": "tempest-keypair-557766472", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:38 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] validate_networks() for [('02d90be5-47ba-45f5-b49d-60de28b6639c', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Getting quotas for project aab9855c5aa444fb8c1636fda0b2f394. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Getting quotas for user d54c4c3585e74670adcb025cf9331844 and project aab9855c5aa444fb8c1636fda0b2f394. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.966802 Apr 14 14:17:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 27/83] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:17:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9cff048c-48f0-4b7f-9e90-be20bb4342aa tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:39 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-9cff048c-48f0-4b7f-9e90-be20bb4342aa tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:39 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-9cff048c-48f0-4b7f-9e90-be20bb4342aa tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c4c3585e74670adcb025cf9331844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9855c5aa444fb8c1636fda0b2f394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9cff048c-48f0-4b7f-9e90-be20bb4342aa tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a" status: 200 len: 1225 microversion: 2.1 time: 0.344594 Apr 14 14:17:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 31/84] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:39 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a => generated 1225 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:41 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-11e86bb4-e72e-4613-b309-99137192ded9 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Action: 'create', calling method: .version_select at 0x7f67e452d630>, body: {"keypair": {"name": "tempest-keypair-1781102291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0Dp/TpbyfNMr6nxhQGUMBOdgpBxSCjIxFTiVwhiVsHPSIl1rtj9HKlYO1jqlh/TGAWy9mUUVXXk78x6JPTXxgIeAN5njjb1VP1diJqaaSnKLXj1ax1f6JAViJUmDdFYw=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:41 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-11e86bb4-e72e-4613-b309-99137192ded9 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Getting quotas for project 8f3e6748a8ce4ef0b22e272d19f6f584. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:41 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-11e86bb4-e72e-4613-b309-99137192ded9 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Getting quotas for user ac3c91ffc9fe4c2a8afa04820908165a and project 8f3e6748a8ce4ef0b22e272d19f6f584. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-11e86bb4-e72e-4613-b309-99137192ded9 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.355330 Apr 14 14:17:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 27/85] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:17:41 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7e2b67b0-7407-48e1-914a-065f65416e8f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Action: 'create', calling method: .version_select at 0x7f67e4580310>, body: {"keypair": {"name": "tempest-keypair-1679569523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ=="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:42 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-7e2b67b0-7407-48e1-914a-065f65416e8f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Getting quotas for project d6bca3db8fa34f948a25621d348995f4. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:42 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-7e2b67b0-7407-48e1-914a-065f65416e8f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Getting quotas for user ec166aaa170041c1a486379c7f417e66 and project d6bca3db8fa34f948a25621d348995f4. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7e2b67b0-7407-48e1-914a-065f65416e8f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.128664 Apr 14 14:17:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 28/86] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 14:17:42 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 14:17:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "tag": "513e9086-658d-44df-962e-3a4f16649083"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Creating event network-changed:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:17:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037619 Apr 14 14:17:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 32/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Creating event network-changed:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:17:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054079 Apr 14 14:17:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 28/88] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-979930942", "imageRef": "010c8455-e9db-4040-a35b-69e3a49846c7", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8"}], "security_groups": [{"name": "tempest-securitygroup--1352068014"}], "key_name": "tempest-keypair-1781102291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:44 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] validate_networks() for [('3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Getting quotas for project 8f3e6748a8ce4ef0b22e272d19f6f584. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Getting quotas for user ac3c91ffc9fe4c2a8afa04820908165a and project 8f3e6748a8ce4ef0b22e272d19f6f584. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:45 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='010c8455-e9db-4040-a35b-69e3a49846c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.070230 Apr 14 14:17:45 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 29/89] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:17:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:17:45 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9c8291f8-955a-4d50-8c53-555ddc133f16 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-9c8291f8-955a-4d50-8c53-555ddc133f16 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1619832572", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "241db769-30f2-408d-80e1-f7bc96865f9a"}], "security_groups": [{"name": "tempest-securitygroup--2033291931"}], "key_name": "tempest-keypair-1679569523", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:45 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-9c8291f8-955a-4d50-8c53-555ddc133f16 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3c91ffc9fe4c2a8afa04820908165a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3e6748a8ce4ef0b22e272d19f6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9c8291f8-955a-4d50-8c53-555ddc133f16 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 200 len: 1239 microversion: 2.1 time: 0.091710 Apr 14 14:17:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 33/90] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:45 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:45 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] validate_networks() for [('241db769-30f2-408d-80e1-f7bc96865f9a', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:17:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "name": "network-vif-plugged", "status": "completed", "tag": "513e9086-658d-44df-962e-3a4f16649083"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Creating event network-vif-plugged:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:17:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055064 Apr 14 14:17:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Getting quotas for project d6bca3db8fa34f948a25621d348995f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Getting quotas for user ec166aaa170041c1a486379c7f417e66 and project d6bca3db8fa34f948a25621d348995f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:17:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:17:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.597071 Apr 14 14:17:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 29/92] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:17:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:17:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-12a8f4d9-d0bd-415f-851f-d3f36a459682 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-12a8f4d9-d0bd-415f-851f-d3f36a459682 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-12a8f4d9-d0bd-415f-851f-d3f36a459682 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-12a8f4d9-d0bd-415f-851f-d3f36a459682 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-12a8f4d9-d0bd-415f-851f-d3f36a459682 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-12a8f4d9-d0bd-415f-851f-d3f36a459682 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 200 len: 1321 microversion: 2.49 time: 0.294594 Apr 14 14:17:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 34/93] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:17:46 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:17:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "name": "network-vif-plugged", "status": "completed", "tag": "513e9086-658d-44df-962e-3a4f16649083"}, {"server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "name": "network-vif-plugged", "status": "completed", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}, {"server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "name": "network-vif-plugged", "status": "completed", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Creating event network-vif-plugged:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:17:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Creating event network-vif-plugged:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:17:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Creating event network-vif-plugged:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:17:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048604 Apr 14 14:17:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Creating event network-changed:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:17:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052121 Apr 14 14:17:48 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 30/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Creating event network-changed:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:17:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035189 Apr 14 14:17:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 35/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:51 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-22cdf4c7-a67c-4ff6-9641-2f60519c9b3a tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 200 len: 1500 microversion: 2.1 time: 0.635263 Apr 14 14:17:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 32/97] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:51 2023] GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 1500 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "name": "network-vif-plugged", "status": "completed", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Creating event network-vif-plugged:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:17:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037633 Apr 14 14:17:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 31/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:53 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a767acbdff4f65bef46f45d0c745f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e71e69f67a4c44be53fa655a7b50e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d29d267e-edf0-4e21-be13-bcc50867dc6d tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" status: 200 len: 1485 microversion: 2.1 time: 0.580967 Apr 14 14:17:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 36/99] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:52 2023] GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => generated 1485 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:17:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-plugged", "status": "completed", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Creating event network-vif-plugged:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:17:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079547 Apr 14 14:17:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "name": "network-vif-plugged", "status": "completed", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Creating event network-vif-plugged:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:17:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037842 Apr 14 14:17:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 32/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-plugged", "status": "completed", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:17:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Creating event network-vif-plugged:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:17:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042853 Apr 14 14:17:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 37/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:17:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=22 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:17:58 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:17:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1c946ff4-b512-4ff9-b066-d4e974760ae2 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1494 microversion: 2.1 time: 0.260696 Apr 14 14:17:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:17:58 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1494 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:02 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=18 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:02 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-57cdcaae-bc27-44f9-a1e5-b70dd8f1d08f tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1538 microversion: 2.1 time: 0.584954 Apr 14 14:18:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 33/104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:01 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1538 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=28 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=16 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:05 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e27123c26e416a8d024d4029249f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec387d0522a482998dc856bf579d1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-675bb9d2-8336-40e6-9731-7c1044f5135e tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 200 len: 1490 microversion: 2.1 time: 0.233427 Apr 14 14:18:05 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 38/105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:05 2023] GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 1490 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=25 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:13 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-840ae1fd-b967-42fa-8e72-75d8b8dbfb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1585 microversion: 2.20 time: 0.654106 Apr 14 14:18:13 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 35/106] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:18:13 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1585 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:18:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2eac7a9d-4580-4eb1-be6d-e0ce1c54e7fa tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Action: 'create', calling method: .version_select at 0x7f67e452dd80>, body: {"keypair": {"name": "tempest-keypair-1171371252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:14 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:14 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:14 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-2eac7a9d-4580-4eb1-be6d-e0ce1c54e7fa tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting quotas for project 1da7ba7bdb124c3880e3394d3bbab296. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:18:14 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-2eac7a9d-4580-4eb1-be6d-e0ce1c54e7fa tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting quotas for user c520c20d1b9f43dc8bf2517dffd76bea and project 1da7ba7bdb124c3880e3394d3bbab296. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:18:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2eac7a9d-4580-4eb1-be6d-e0ce1c54e7fa tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.056046 Apr 14 14:18:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 34/107] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 14:18:14 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 14:18:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1806973002", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "5d0243d2-2246-4474-a20b-7456780b2a1e"}, {"port": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "tag": "port-1"}, {"port": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "tag": "port-2"}, {"uuid": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "tag": "net-1"}, {"uuid": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5"}, {"uuid": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7122a873-6fa1-4dab-80ba-8ba4d9804896", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9c212e76-aa19-4748-8d6a-475e52283dda", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1780035098"}], "key_name": "tempest-keypair-1171371252", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:15 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] validate_networks() for [('5d0243d2-2246-4474-a20b-7456780b2a1e', None, None, None, None, None), (None, None, 'cc5e8a3d-7a5f-4cd7-907b-6c91f479b371', None, None, None), (None, None, 'd6821969-0f10-4fd6-9c25-0a52e658eca6', None, None, None), ('d7cfa24f-ac75-41ae-a03c-aadea36f3fc5', None, None, None, None, None), ('d7cfa24f-ac75-41ae-a03c-aadea36f3fc5', None, None, None, None, None), ('e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b', '10.2.2.100', None, None, None, None), ('e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b', '10.2.2.200', None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:18:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=5 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting quotas for project 1da7ba7bdb124c3880e3394d3bbab296. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:18:17 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting quotas for user c520c20d1b9f43dc8bf2517dffd76bea and project 1da7ba7bdb124c3880e3394d3bbab296. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:18:18 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:18:18 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7122a873-6fa1-4dab-80ba-8ba4d9804896',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9c212e76-aa19-4748-8d6a-475e52283dda',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5',volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:18:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.857576 Apr 14 14:18:18 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 39/108] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 14:18:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:18:18 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-994749fc-18f5-4564-ba4e-f4f30f6dacb6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:18 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-994749fc-18f5-4564-ba4e-f4f30f6dacb6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:18 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-994749fc-18f5-4564-ba4e-f4f30f6dacb6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:18 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-994749fc-18f5-4564-ba4e-f4f30f6dacb6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:18 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-994749fc-18f5-4564-ba4e-f4f30f6dacb6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:18 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-994749fc-18f5-4564-ba4e-f4f30f6dacb6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 200 len: 1280 microversion: 2.42 time: 0.084482 Apr 14 14:18:18 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 36/109] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:18:18 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:18:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:24 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Creating event network-changed:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Apr 14 14:18:24 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 35/110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:18:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371"}, {"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "d6821969-0f10-4fd6-9c25-0a52e658eca6"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Creating event network-changed:cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Creating event network-changed:d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033659 Apr 14 14:18:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 40/111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:27 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3d247d93-8473-4203-8c83-c9c65533f775 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e" status: 200 len: 1545 microversion: 2.1 time: 0.463245 Apr 14 14:18:27 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:26 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e => generated 1545 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "3bfcc6b7-6768-47b7-ae40-f951761442a5"}, {"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "2f7a292d-75de-404e-bb4c-93e2bc9d190b"}, {"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "e060de39-0ed8-4aa3-9046-222f9254ddfe"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Creating event network-changed:3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Creating event network-changed:2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Creating event network-changed:e060de39-0ed8-4aa3-9046-222f9254ddfe for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.029228 Apr 14 14:18:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 36/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:28 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:30 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c4c3585e74670adcb025cf9331844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9855c5aa444fb8c1636fda0b2f394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5b148182-08e5-410c-88f8-87e923bd93c4 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a" status: 200 len: 1523 microversion: 2.1 time: 0.230127 Apr 14 14:18:30 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 41/114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:29 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:30 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "7923b754-a636-4e91-b166-ce9b0c0fce99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:30 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Creating event network-changed:7923b754-a636-4e91-b166-ce9b0c0fce99 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029417 Apr 14 14:18:30 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:35 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3c91ffc9fe4c2a8afa04820908165a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3e6748a8ce4ef0b22e272d19f6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:35 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-daba673a-c3b7-4bda-b70e-ccae22c45787 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 200 len: 1549 microversion: 2.1 time: 0.341957 Apr 14 14:18:35 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 37/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:35 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 1549 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:37 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0b0ea802-aeda-4732-a801-d0132004c244 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 200 len: 1628 microversion: 2.49 time: 0.318663 Apr 14 14:18:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 42/117] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:18:37 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 1628 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:18:44 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:44 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Creating event network-vif-plugged:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039096 Apr 14 14:18:44 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "d6821969-0f10-4fd6-9c25-0a52e658eca6"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Creating event network-vif-plugged:d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049211 Apr 14 14:18:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 38/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:45 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "e060de39-0ed8-4aa3-9046-222f9254ddfe"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:45 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Creating event network-vif-plugged:e060de39-0ed8-4aa3-9046-222f9254ddfe for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053818 Apr 14 14:18:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 43/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "3bfcc6b7-6768-47b7-ae40-f951761442a5"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "3bfcc6b7-6768-47b7-ae40-f951761442a5"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "7923b754-a636-4e91-b166-ce9b0c0fce99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Creating event network-vif-plugged:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Creating event network-vif-plugged:cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Creating event network-vif-plugged:cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Creating event network-vif-plugged:3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Creating event network-vif-plugged:3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Creating event network-vif-plugged:7923b754-a636-4e91-b166-ce9b0c0fce99 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.044130 Apr 14 14:18:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:46 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "d6821969-0f10-4fd6-9c25-0a52e658eca6"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "2f7a292d-75de-404e-bb4c-93e2bc9d190b"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "2f7a292d-75de-404e-bb4c-93e2bc9d190b"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Creating event network-vif-plugged:d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Creating event network-vif-plugged:2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Creating event network-vif-plugged:2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038975 Apr 14 14:18:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 39/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "e060de39-0ed8-4aa3-9046-222f9254ddfe"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:47 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=19 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Creating event network-vif-plugged:e060de39-0ed8-4aa3-9046-222f9254ddfe for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254828 Apr 14 14:18:48 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 44/123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "7923b754-a636-4e91-b166-ce9b0c0fce99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Creating event network-vif-plugged:7923b754-a636-4e91-b166-ce9b0c0fce99 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:18:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038922 Apr 14 14:18:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:51 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:18:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258/action" status: 200 len: 32 microversion: 2.1 time: 0.200032 Apr 14 14:18:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 40/125] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:18:51 2023] POST /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-fbb487a0-4177-4aeb-9c76-9a4bfec044fe tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 200 len: 1506 microversion: 2.1 time: 0.257203 Apr 14 14:18:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 45/126] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:52 2023] GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:18:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-unplugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Creating event network-vif-unplugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:18:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050950 Apr 14 14:18:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 42/127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:55 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=13 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:18:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Creating event network-vif-plugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:18:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043103 Apr 14 14:18:55 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 41/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}, {"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Creating event network-vif-plugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:18:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Creating event network-vif-plugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:18:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034878 Apr 14 14:18:57 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 46/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:18:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1371872177", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:18:58 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] validate_networks() for [('6dbfb18b-1c4c-42fe-8597-3b57e05446a2', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Getting quotas for project 08dbbd3691924823b98d44b11508019e. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Getting quotas for user a609ae82102a4ec994823e59f1a37378 and project 08dbbd3691924823b98d44b11508019e. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:18:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:18:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.012849 Apr 14 14:18:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 43/130] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:18:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:18:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b762d5e5-a5b0-4e15-86ec-b5e21b6b06b8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:18:59 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b762d5e5-a5b0-4e15-86ec-b5e21b6b06b8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:18:59 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b762d5e5-a5b0-4e15-86ec-b5e21b6b06b8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:18:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b762d5e5-a5b0-4e15-86ec-b5e21b6b06b8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 200 len: 1211 microversion: 2.1 time: 0.087631 Apr 14 14:18:59 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 42/131] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:18:59 2023] GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:19:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" status: 204 len: 0 microversion: 2.1 time: 0.229578 Apr 14 14:19:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 47/132] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:19:00 2023] DELETE /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:01 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a767acbdff4f65bef46f45d0c745f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e71e69f67a4c44be53fa655a7b50e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-cba74cfa-63ec-40cd-819b-7f3c844c1090 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" status: 200 len: 1491 microversion: 2.1 time: 0.363163 Apr 14 14:19:01 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:00 2023] GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => generated 1491 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "03114745-3adc-4f7e-b3e5-6623abee6e40"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Creating event network-vif-unplugged:03114745-3adc-4f7e-b3e5-6623abee6e40 for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 on user Apr 14 14:19:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043218 Apr 14 14:19:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 43/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4", "name": "network-vif-deleted", "tag": "03114745-3adc-4f7e-b3e5-6623abee6e40"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] Creating event network-vif-deleted:03114745-3adc-4f7e-b3e5-6623abee6e40 for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 on user Apr 14 14:19:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096061 Apr 14 14:19:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:02 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ab915d93-2b67-47b3-ba3d-9b8f55c3dee3 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.379212 Apr 14 14:19:02 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 48/136] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:19:02 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-interface => generated 282 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:19:03 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4", "name": "network-vif-plugged", "status": "completed", "tag": "03114745-3adc-4f7e-b3e5-6623abee6e40"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Creating event network-vif-plugged:03114745-3adc-4f7e-b3e5-6623abee6e40 for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 on user Apr 14 14:19:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038165 Apr 14 14:19:03 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:04 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40364b4-9668-45e3-8d72-d6e49ebb0147", "tag": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Creating event network-changed:dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance f40364b4-9668-45e3-8d72-d6e49ebb0147 on user Apr 14 14:19:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036180 Apr 14 14:19:04 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:05 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-93be2dc2-8884-41cd-85ef-3a9743493880 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1538 microversion: 2.1 time: 0.262720 Apr 14 14:19:05 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 49/139] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:04 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1538 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:05 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:05 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0121fddf-3235-42b6-9977-80c9e04213e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1538 microversion: 2.1 time: 0.250510 Apr 14 14:19:05 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 45/140] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:05 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1538 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:05 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:05 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Creating event network-changed:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:19:05 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028899 Apr 14 14:19:05 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40364b4-9668-45e3-8d72-d6e49ebb0147", "name": "network-vif-plugged", "status": "completed", "tag": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Creating event network-vif-plugged:dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance f40364b4-9668-45e3-8d72-d6e49ebb0147 on user Apr 14 14:19:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028761 Apr 14 14:19:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 50/142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40364b4-9668-45e3-8d72-d6e49ebb0147", "name": "network-vif-plugged", "status": "completed", "tag": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Creating event network-vif-plugged:dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance f40364b4-9668-45e3-8d72-d6e49ebb0147 on user Apr 14 14:19:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036900 Apr 14 14:19:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 46/143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:09 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:09 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:09 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:09 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-964057be-72be-44e7-8f05-ec611e2ed967 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 200 len: 2830 microversion: 2.42 time: 0.542511 Apr 14 14:19:09 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 48/144] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:19:08 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 2830 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdf0ef7a-ce14-4a26-8aba-068a1326d8fa"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443957 Apr 14 14:19:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 51/145] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:19:09 2023] POST /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b952c264-be65-457f-9774-bf6e4530be53 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.168689 Apr 14 14:19:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 47/146] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:19:13 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-interface => generated 282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0dd76149-9c53-4984-a767-7946f917b990 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/ips" status: 200 len: 109 microversion: 2.20 time: 0.037638 Apr 14 14:19:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 52/147] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 14:19:15 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/ips => generated 109 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=29 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Creating event network-changed:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:19:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206855 Apr 14 14:19:15 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:18 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'flavor' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:19:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/action" status: 202 len: 0 microversion: 2.20 time: 1.018052 Apr 14 14:19:19 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 48/149] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:19:18 2023] POST /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/action => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:19 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-unplugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Creating event network-vif-unplugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043193 Apr 14 14:19:19 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:19 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-906772cf-c438-4bc5-ac17-861dec74fb8f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1710 microversion: 2.20 time: 0.378737 Apr 14 14:19:19 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 53/151] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:19:19 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1710 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:19:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 204 len: 0 microversion: 2.1 time: 0.156357 Apr 14 14:19:21 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 49/152] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:19:21 2023] DELETE /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-plugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06baebb6-4922-4d82-b396-48bf76c60f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ec51781-92ba-45d2-9635-5aa1c6cf918a"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:21 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e27123c26e416a8d024d4029249f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec387d0522a482998dc856bf579d1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Creating event network-vif-unplugged:1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance 06baebb6-4922-4d82-b396-48bf76c60f2d on user Apr 14 14:19:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Creating event network-vif-plugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:19:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034361 Apr 14 14:19:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-300b082d-a1b0-4fd3-90ba-71caf2f9a405 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 200 len: 1542 microversion: 2.1 time: 0.333463 Apr 14 14:19:21 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 50/153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:21 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:21 2023] GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 1542 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054401 Apr 14 14:19:21 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 54/155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:23 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06baebb6-4922-4d82-b396-48bf76c60f2d", "name": "network-vif-deleted", "tag": "1ec51781-92ba-45d2-9635-5aa1c6cf918a"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] Creating event network-vif-deleted:1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance 06baebb6-4922-4d82-b396-48bf76c60f2d on user Apr 14 14:19:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Apr 14 14:19:23 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 51/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:23 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06baebb6-4922-4d82-b396-48bf76c60f2d", "name": "network-vif-plugged", "status": "completed", "tag": "1ec51781-92ba-45d2-9635-5aa1c6cf918a"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:23 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Creating event network-vif-plugged:1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance 06baebb6-4922-4d82-b396-48bf76c60f2d on user Apr 14 14:19:23 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043620 Apr 14 14:19:23 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 52/157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Creating event network-changed:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:19:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Apr 14 14:19:25 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 55/158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:27 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6703bdea-4c04-4817-bfee-7d3f661d7adc tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.203508 Apr 14 14:19:27 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 52/159] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:19:27 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-interface => generated 282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "tag": "513e9086-658d-44df-962e-3a4f16649083"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Creating event network-changed:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:19:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042295 Apr 14 14:19:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 53/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d6e9192c-00fe-417b-b650-bacc2a14f18f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.179506 Apr 14 14:19:30 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 56/161] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:19:30 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "183777d6-8fe6-4b09-b33f-759cf148aac1"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:31 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445975 Apr 14 14:19:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 53/162] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:19:30 2023] POST /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:32 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Creating event network-changed:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:19:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048409 Apr 14 14:19:32 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c65a03b-5934-480a-9047-4182f7796fcd"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:32 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277226 Apr 14 14:19:32 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 57/164] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:19:32 2023] POST /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:35 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f22a37c7-208d-45bc-8f0b-00993932d6dd tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.220856 Apr 14 14:19:35 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 54/165] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:19:35 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-interface => generated 282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Creating event network-changed:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:19:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041556 Apr 14 14:19:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-93211ced-ef77-4cc2-8418-a8af87e8a029 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.253185 Apr 14 14:19:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 58/167] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:19:37 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-interface => generated 282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:19:38 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:38 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Creating event network-changed:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:38 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043191 Apr 14 14:19:38 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 55/168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-347f288e-3f44-48e7-b5fe-6aeabb935577 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 200 len: 1628 microversion: 2.49 time: 0.348188 Apr 14 14:19:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 56/169] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:19:38 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 1628 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "d745af4d-df01-4467-bda6-07840054785a", "tag": "nic-tag"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] HTTP exception thrown: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Request method failure captured: Apr 14 14:19:39 user devstack@n-api.service[61718]: request: PUT /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments/183777d6-8fe6-4b09-b33f-759cf148aac1 HTTP/1.1 Apr 14 14:19:39 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:19:39 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:19:39 user devstack@n-api.service[61718]: Connection: close Apr 14 14:19:39 user devstack@n-api.service[61718]: Content-Length: 74 Apr 14 14:19:39 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:19:39 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:19:39 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:19:39 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWB030ECMEEF4kz-zus4dhCXJkhL5m1UGhsx19fG8A4frOUp-PGTMNBMciuVHq0F9kl6MOwjfcvb-W3aV4hmIII2W9wZZf_PhmB_kTsa_Cuds8JWrnEnyRyOXcVZLTQyerD_KhI7u6V-nFL7ECHr3_elbUQt_hOJhvgQZa-gixSNCAg Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Project-Id: 6a51e590acc648fda0320f09f1525b83 Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesAdminNegativeTest-698490239 Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Role: member,admin,reader Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Roles: member,admin,reader Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a51e590acc648fda0320f09f1525b83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a51e590acc648fda0320f09f1525b83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a51e590acc648fda0320f09f1525b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesAdminNegativeTest-698490239 Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Tenant-Id: 6a51e590acc648fda0320f09f1525b83 Apr 14 14:19:39 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-698490239 Apr 14 14:19:39 user devstack@n-api.service[61718]: X-User: tempest-VolumesAdminNegativeTest-698490239-project-admin Apr 14 14:19:39 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:19:39 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:19:39 user devstack@n-api.service[61718]: X-User-Id: 1fc191b61c5f45eeaa2f00b34652075b Apr 14 14:19:39 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesAdminNegativeTest-698490239-project-admin Apr 14 14:19:39 user devstack@n-api.service[61718]: Apr 14 14:19:39 user devstack@n-api.service[61718]: {"volumeAttachment": {"volumeId": "9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd"}} Apr 14 14:19:39 user devstack@n-api.service[61718]: method: > Apr 14 14:19:39 user devstack@n-api.service[61718]: exception: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. Apr 14 14:19:39 user devstack@n-api.service[61718]: action_args: {'server_id': 'bc70d475-20dd-4859-a6fe-d2d09341799e', 'id': '183777d6-8fe6-4b09-b33f-759cf148aac1', 'body': {'volumeAttachment': {'volumeId': '9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd'}}} Apr 14 14:19:39 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. (HTTP 404) (Request-ID: req-0798cba2-9f77-43c3-b268-9f8190ac0029) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. Apr 14 14:19:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Returning 400 to user: Volume 9e3a7cc8-58d5-49ef-ae0c-49f8a897b4cd could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:19:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-86d8b670-a274-4362-8644-421db67f7726 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments/183777d6-8fe6-4b09-b33f-759cf148aac1" status: 400 len: 107 microversion: 2.1 time: 0.364129 Apr 14 14:19:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 59/170] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 14:19:39 2023] PUT /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments/183777d6-8fe6-4b09-b33f-759cf148aac1 => generated 107 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'services' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:19:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments/183777d6-8fe6-4b09-b33f-759cf148aac1" status: 202 len: 0 microversion: 2.1 time: 0.356554 Apr 14 14:19:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:19:39 2023] DELETE /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments/183777d6-8fe6-4b09-b33f-759cf148aac1 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "POST /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353253 Apr 14 14:19:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 60/172] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:19:39 2023] POST /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5ef78a99-405f-4c49-9baa-4b3cd27af41c tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129883 Apr 14 14:19:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:19:39 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2c498d1f-d79d-49e7-8155-3da0efa7d798"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments/9c65a03b-5934-480a-9047-4182f7796fcd" status: 202 len: 0 microversion: 2.1 time: 0.477588 Apr 14 14:19:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 61/174] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 14:19:41 2023] PUT /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments/9c65a03b-5934-480a-9047-4182f7796fcd => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:19:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "tag": "0653f24c-4a60-4257-afa3-74814f106945"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Creating event network-changed:0653f24c-4a60-4257-afa3-74814f106945 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Apr 14 14:19:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-fa414a82-432a-4c49-b696-fad0c9067726 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 200 len: 1486 microversion: 2.1 time: 0.369277 Apr 14 14:19:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 62/176] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:42 2023] GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 1486 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:42 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-interface" status: 200 len: 281 microversion: 2.49 time: 4.153493 Apr 14 14:19:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 56/177] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 14:19:39 2023] POST /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-interface => generated 281 bytes in 4155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd055840-5942-4ab4-9f6a-4138dc80ddf8", "tag": "volume-tag"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-plugged", "status": "completed", "tag": "0653f24c-4a60-4257-afa3-74814f106945"}, {"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-plugged", "status": "completed", "tag": "0653f24c-4a60-4257-afa3-74814f106945"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Creating event network-vif-plugged:0653f24c-4a60-4257-afa3-74814f106945 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Creating event network-vif-plugged:0653f24c-4a60-4257-afa3-74814f106945 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031141 Apr 14 14:19:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 63/178] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.317327 Apr 14 14:19:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 60/179] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 14:19:43 2023] POST /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:47 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2580e110-2295-4f70-bccf-1724090cd3a8 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Apr 14 14:19:47 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 57/180] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:19:47 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:47 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'services' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:19:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments/ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a" status: 202 len: 0 microversion: 2.1 time: 0.289912 Apr 14 14:19:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 64/181] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:19:47 2023] DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments/ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=24 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:49 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5ffa602d-da78-47f1-a0a3-297984c85e2e tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 200 len: 1494 microversion: 2.1 time: 0.291189 Apr 14 14:19:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:49 2023] GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 1494 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-9a640953-e6a9-4954-923f-49bd9e51158d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054874 Apr 14 14:19:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 58/183] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:19:51 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=24 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:19:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9ee4f979-b63d-4a56-9f12-f05e06c30110 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072258 Apr 14 14:19:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 65/184] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:19:51 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] HTTP exception thrown: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Request method failure captured: Apr 14 14:19:51 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 HTTP/1.1 Apr 14 14:19:51 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:19:51 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:19:51 user devstack@n-api.service[61716]: Connection: close Apr 14 14:19:51 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:19:51 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:19:51 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:19:51 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:19:51 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBUJm4WxHb5Sg-iI1Hkr8qLsBnlAJYjKMOBk3XTJNVa9y7xBNJR9ER4xIe3P6dI967GgZEto0kC7vwllnhUddUQ8QbFtj-vJSVvP-O7ddzNSyYSq7yhuV4ENvJhaf2hAXCXz1loMRN9caVE2VF-Bg-gj6eoKeKXkF3ChcL8xdR17t4 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Project-Id: b3e71e69f67a4c44be53fa655a7b50e5 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesActionsTest-1835732015 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3e71e69f67a4c44be53fa655a7b50e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3e71e69f67a4c44be53fa655a7b50e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3e71e69f67a4c44be53fa655a7b50e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesActionsTest-1835732015 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Tenant-Id: b3e71e69f67a4c44be53fa655a7b50e5 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesActionsTest-1835732015 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-User: tempest-VolumesActionsTest-1835732015-project-member Apr 14 14:19:51 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:19:51 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:19:51 user devstack@n-api.service[61716]: X-User-Id: f6a767acbdff4f65bef46f45d0c745f7 Apr 14 14:19:51 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesActionsTest-1835732015-project-member Apr 14 14:19:51 user devstack@n-api.service[61716]: method: > Apr 14 14:19:51 user devstack@n-api.service[61716]: exception: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. Apr 14 14:19:51 user devstack@n-api.service[61716]: action_args: {'id': '6ff5dcc6-7fcf-4785-88dd-f3104832a2b4'} Apr 14 14:19:51 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. Apr 14 14:19:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:19:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Returning 404 to user: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:19:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-aae57618-fa14-4274-b88b-924200a2fa65 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" status: 404 len: 111 microversion: 2.1 time: 0.033395 Apr 14 14:19:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:51 2023] GET /compute/v2.1/servers/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:19:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 204 len: 0 microversion: 2.1 time: 0.142189 Apr 14 14:19:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 59/186] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:19:51 2023] DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac3c91ffc9fe4c2a8afa04820908165a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3e6748a8ce4ef0b22e272d19f6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-fbfa80e7-d87f-4d52-a970-7a8235f6a92d tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 200 len: 1674 microversion: 2.1 time: 0.412669 Apr 14 14:19:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 66/187] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:51 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 1674 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Creating event network-vif-unplugged:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:19:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039138 Apr 14 14:19:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 63/188] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:52 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'services' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:19:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-volume_attachments/bd055840-5942-4ab4-9f6a-4138dc80ddf8" status: 202 len: 0 microversion: 2.49 time: 0.372788 Apr 14 14:19:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 60/189] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 14:19:52 2023] DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-volume_attachments/bd055840-5942-4ab4-9f6a-4138dc80ddf8 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-59051ae6-7e1c-4981-8574-35d478e9fc48 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050262 Apr 14 14:19:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 67/190] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:19:54 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a6cfd82c-48b1-4b2a-a9bd-ad09c8e388c3 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049417 Apr 14 14:19:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:19:54 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9c65a03b-5934-480a-9047-4182f7796fcd"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "name": "network-vif-plugged", "status": "completed", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}, {"server_uuid": "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d", "name": "network-vif-deleted", "tag": "45351ca7-0534-4a7c-806b-71b0412f4e5d"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Creating event network-vif-plugged:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:19:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Creating event network-vif-deleted:45351ca7-0534-4a7c-806b-71b0412f4e5d for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d on user Apr 14 14:19:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034775 Apr 14 14:19:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 68/192] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments/2c498d1f-d79d-49e7-8155-3da0efa7d798" status: 202 len: 0 microversion: 2.1 time: 0.347013 Apr 14 14:19:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 61/193] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 14:19:54 2023] PUT /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments/2c498d1f-d79d-49e7-8155-3da0efa7d798 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-interface/0653f24c-4a60-4257-afa3-74814f106945" status: 202 len: 0 microversion: 2.49 time: 0.046960 Apr 14 14:19:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 65/194] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 14:19:54 2023] DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-interface/0653f24c-4a60-4257-afa3-74814f106945 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e611c2b5-98fd-490c-82b0-791131f1f6e9 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-instance-actions/req-13dc0677-72ca-4934-967a-682a276b5684" status: 200 len: 474 microversion: 2.49 time: 0.213740 Apr 14 14:19:55 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 69/195] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 14:19:54 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-instance-actions/req-13dc0677-72ca-4934-967a-682a276b5684 => generated 474 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:55 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b95cad95-c7b3-4e1c-b9a1-fcc125434110 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1657 microversion: 2.1 time: 0.532901 Apr 14 14:19:55 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 62/196] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:55 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1657 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-unplugged", "status": "completed", "tag": "0653f24c-4a60-4257-afa3-74814f106945"}, {"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-plugged", "status": "completed", "tag": "0653f24c-4a60-4257-afa3-74814f106945"}, {"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-deleted", "tag": "0653f24c-4a60-4257-afa3-74814f106945"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:19:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:19:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:19:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:19:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Creating event network-vif-unplugged:0653f24c-4a60-4257-afa3-74814f106945 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Creating event network-vif-plugged:0653f24c-4a60-4257-afa3-74814f106945 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Creating event network-vif-deleted:0653f24c-4a60-4257-afa3-74814f106945 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:19:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042717 Apr 14 14:19:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 70/197] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:19:56 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:19:56 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bf4ba156-9977-4550-87b1-95bd9f8603e0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1657 microversion: 2.1 time: 0.476615 Apr 14 14:19:56 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 66/198] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:19:55 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1657 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=11 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=29 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8761054e-6305-4756-a05c-41ff7c50a132 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052833 Apr 14 14:20:09 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 71/199] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:20:09 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=11 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-65b725c8-4f2b-4b21-9aff-24f0a8b50950 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.428010 Apr 14 14:20:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 63/200] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:20:09 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac/os-interface => generated 1830 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:20:09 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-314163a1-3481-46d5-8309-40d4b31f898f tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055979 Apr 14 14:20:09 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:20:09 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:09 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'services' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:09 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-59ccbe29-b829-4ce8-bbbb-cd4811c4e630 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1651 microversion: 2.20 time: 0.276762 Apr 14 14:20:09 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 72/202] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:20:09 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1651 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:20:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments/9c65a03b-5934-480a-9047-4182f7796fcd" status: 202 len: 0 microversion: 2.1 time: 0.172787 Apr 14 14:20:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 64/203] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:20:09 2023] DELETE /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments/9c65a03b-5934-480a-9047-4182f7796fcd => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:09 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2618d0a7-c151-4e22-8f2c-2c94feebba72 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046970 Apr 14 14:20:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:20:09 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Creating event network-changed:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043054 Apr 14 14:20:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 73/205] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b7783afd-6824-4188-9775-32cb577d52da tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 200 len: 2830 microversion: 2.42 time: 0.476614 Apr 14 14:20:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 65/206] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:20:10 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 2830 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c7c5b7dd-1b26-4401-a975-7c72b2ceb6a6 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.413368 Apr 14 14:20:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 69/207] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:20:11 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac/os-interface => generated 1830 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] HTTP exception thrown: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Request method failure captured: Apr 14 14:20:11 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d HTTP/1.1 Apr 14 14:20:11 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:20:11 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:20:11 user devstack@n-api.service[61718]: Connection: close Apr 14 14:20:11 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:20:11 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:20:11 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:20:11 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:20:11 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBo_seqcmXhz-LyR334NVygAWkO1rWgInG1SX8FbpIWkhPEee75SET9Uk6ohi9FPLvGv5BWoERQIqmxeHuu4xWm7NdnN9GSLI7H_SlcEAe9WkcOyWeB50FgAldFGF2iON3xEicX6cKTJvv6jcyrnYRfeZ_y8uc5U3zDUTQ0p17mgt0 Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Project-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Project-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Tenant: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Tenant-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:11 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:11 user devstack@n-api.service[61718]: X-User: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:11 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:20:11 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:20:11 user devstack@n-api.service[61718]: X-User-Id: 43e27123c26e416a8d024d4029249f4b Apr 14 14:20:11 user devstack@n-api.service[61718]: X-User-Name: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:11 user devstack@n-api.service[61718]: method: > Apr 14 14:20:11 user devstack@n-api.service[61718]: exception: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61718]: action_args: {'id': '06baebb6-4922-4d82-b396-48bf76c60f2d'} Apr 14 14:20:11 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Returning 404 to user: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ce796581-255c-4c64-b6e7-3b691b9f5fb7 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 404 len: 111 microversion: 2.1 time: 0.037157 Apr 14 14:20:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 74/208] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:11 2023] GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] HTTP exception thrown: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Request method failure captured: Apr 14 14:20:11 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d/os-volume_attachments HTTP/1.1 Apr 14 14:20:11 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:20:11 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:20:11 user devstack@n-api.service[61717]: Connection: close Apr 14 14:20:11 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:20:11 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:20:11 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:20:11 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:20:11 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBo_seqcmXhz-LyR334NVygAWkO1rWgInG1SX8FbpIWkhPEee75SET9Uk6ohi9FPLvGv5BWoERQIqmxeHuu4xWm7NdnN9GSLI7H_SlcEAe9WkcOyWeB50FgAldFGF2iON3xEicX6cKTJvv6jcyrnYRfeZ_y8uc5U3zDUTQ0p17mgt0 Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Project-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Project-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Tenant: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Tenant-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:11 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:11 user devstack@n-api.service[61717]: X-User: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:11 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:20:11 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:20:11 user devstack@n-api.service[61717]: X-User-Id: 43e27123c26e416a8d024d4029249f4b Apr 14 14:20:11 user devstack@n-api.service[61717]: X-User-Name: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:11 user devstack@n-api.service[61717]: method: > Apr 14 14:20:11 user devstack@n-api.service[61717]: exception: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61717]: action_args: {'server_id': '06baebb6-4922-4d82-b396-48bf76c60f2d'} Apr 14 14:20:11 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:11 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:11 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Returning 404 to user: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-81a26e26-8ac0-45a9-b775-7210bba1c7b9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040273 Apr 14 14:20:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 66/209] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:20:11 2023] GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:12 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:20:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 204 len: 0 microversion: 2.42 time: 0.161312 Apr 14 14:20:13 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 70/210] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:20:12 2023] DELETE /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-3f38372d-99cb-422b-b99e-53a9de83850b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 200 len: 2955 microversion: 2.42 time: 0.287103 Apr 14 14:20:13 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 75/211] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:20:13 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 2955 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:20:13 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Creating event network-vif-unplugged:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033760 Apr 14 14:20:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 67/212] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:13 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "d6821969-0f10-4fd6-9c25-0a52e658eca6"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Creating event network-vif-unplugged:d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033245 Apr 14 14:20:13 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 71/213] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "e060de39-0ed8-4aa3-9046-222f9254ddfe"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:14 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Creating event network-vif-unplugged:e060de39-0ed8-4aa3-9046-222f9254ddfe for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:14 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042661 Apr 14 14:20:14 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 76/214] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:20:15 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "3bfcc6b7-6768-47b7-ae40-f951761442a5"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "3bfcc6b7-6768-47b7-ae40-f951761442a5"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "7923b754-a636-4e91-b166-ce9b0c0fce99"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "7923b754-a636-4e91-b166-ce9b0c0fce99"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:15 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:15 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:15 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-plugged:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-unplugged:cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-plugged:cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-unplugged:3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-plugged:3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-unplugged:7923b754-a636-4e91-b166-ce9b0c0fce99 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Creating event network-vif-plugged:7923b754-a636-4e91-b166-ce9b0c0fce99 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.039982 Apr 14 14:20:15 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 68/215] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 14:20:15 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:15 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "d6821969-0f10-4fd6-9c25-0a52e658eca6"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-unplugged", "status": "completed", "tag": "2f7a292d-75de-404e-bb4c-93e2bc9d190b"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "2f7a292d-75de-404e-bb4c-93e2bc9d190b"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Creating event network-vif-plugged:d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Creating event network-vif-unplugged:2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Creating event network-vif-plugged:2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039691 Apr 14 14:20:15 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:15 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:16 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-plugged", "status": "completed", "tag": "e060de39-0ed8-4aa3-9046-222f9254ddfe"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:16 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Creating event network-vif-plugged:e060de39-0ed8-4aa3-9046-222f9254ddfe for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:16 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.411847 Apr 14 14:20:16 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 77/217] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] HTTP exception thrown: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Request method failure captured: Apr 14 14:20:16 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d HTTP/1.1 Apr 14 14:20:16 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:20:16 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:20:16 user devstack@n-api.service[61717]: Connection: close Apr 14 14:20:16 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:20:16 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:20:16 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:20:16 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:20:16 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBo_seqcmXhz-LyR334NVygAWkO1rWgInG1SX8FbpIWkhPEee75SET9Uk6ohi9FPLvGv5BWoERQIqmxeHuu4xWm7NdnN9GSLI7H_SlcEAe9WkcOyWeB50FgAldFGF2iON3xEicX6cKTJvv6jcyrnYRfeZ_y8uc5U3zDUTQ0p17mgt0 Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Project-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Project-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Tenant: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Tenant-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:16 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:16 user devstack@n-api.service[61717]: X-User: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:16 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:20:16 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:20:16 user devstack@n-api.service[61717]: X-User-Id: 43e27123c26e416a8d024d4029249f4b Apr 14 14:20:16 user devstack@n-api.service[61717]: X-User-Name: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:16 user devstack@n-api.service[61717]: method: > Apr 14 14:20:16 user devstack@n-api.service[61717]: exception: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61717]: action_args: {'id': '06baebb6-4922-4d82-b396-48bf76c60f2d'} Apr 14 14:20:16 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Returning 404 to user: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c1024426-ae56-4a6a-bfc1-056981e033b1 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 404 len: 111 microversion: 2.1 time: 0.044544 Apr 14 14:20:16 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 69/218] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:20:16 2023] DELETE /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] HTTP exception thrown: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Request method failure captured: Apr 14 14:20:16 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d HTTP/1.1 Apr 14 14:20:16 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:20:16 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:20:16 user devstack@n-api.service[61716]: Connection: close Apr 14 14:20:16 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:20:16 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:20:16 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:20:16 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:20:16 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBo_seqcmXhz-LyR334NVygAWkO1rWgInG1SX8FbpIWkhPEee75SET9Uk6ohi9FPLvGv5BWoERQIqmxeHuu4xWm7NdnN9GSLI7H_SlcEAe9WkcOyWeB50FgAldFGF2iON3xEicX6cKTJvv6jcyrnYRfeZ_y8uc5U3zDUTQ0p17mgt0 Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Project-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Project-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4ec387d0522a482998dc856bf579d1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Tenant: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Tenant-Id: 4ec387d0522a482998dc856bf579d1af Apr 14 14:20:16 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-DeleteServersTestJSON-2021198395 Apr 14 14:20:16 user devstack@n-api.service[61716]: X-User: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:16 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:20:16 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:20:16 user devstack@n-api.service[61716]: X-User-Id: 43e27123c26e416a8d024d4029249f4b Apr 14 14:20:16 user devstack@n-api.service[61716]: X-User-Name: tempest-DeleteServersTestJSON-2021198395-project-member Apr 14 14:20:16 user devstack@n-api.service[61716]: method: > Apr 14 14:20:16 user devstack@n-api.service[61716]: exception: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61716]: action_args: {'id': '06baebb6-4922-4d82-b396-48bf76c60f2d'} Apr 14 14:20:16 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. Apr 14 14:20:16 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:20:16 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Returning 404 to user: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-97483896-2b60-455c-b56f-d748c8c79f89 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d" status: 404 len: 111 microversion: 2.1 time: 0.031255 Apr 14 14:20:16 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:16 2023] GET /compute/v2.1/servers/06baebb6-4922-4d82-b396-48bf76c60f2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:20:18 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-deleted", "tag": "3bfcc6b7-6768-47b7-ae40-f951761442a5"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] Creating event network-vif-deleted:3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 Apr 14 14:20:18 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 78/220] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:20 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-deleted", "tag": "2f7a292d-75de-404e-bb4c-93e2bc9d190b"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-deleted", "tag": "e060de39-0ed8-4aa3-9046-222f9254ddfe"}, {"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-deleted", "tag": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:20 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:20 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:20 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:20 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Creating event network-vif-deleted:2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:20 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Creating event network-vif-deleted:e060de39-0ed8-4aa3-9046-222f9254ddfe for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:20 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] Creating event network-vif-deleted:6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:20 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041183 Apr 14 14:20:20 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 70/221] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:20 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56967036-c176-4423-aa3e-c78ee4e364ac", "name": "network-vif-deleted", "tag": "7923b754-a636-4e91-b166-ce9b0c0fce99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] Creating event network-vif-deleted:7923b754-a636-4e91-b166-ce9b0c0fce99 for instance 56967036-c176-4423-aa3e-c78ee4e364ac on user Apr 14 14:20:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042117 Apr 14 14:20:22 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=16 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=28 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ab1e842b-2fd3-47ab-bd04-d0b612fd7280 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059992 Apr 14 14:20:30 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 79/223] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:20:30 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:20:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-221621999", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "40223427-597e-4817-ab9c-7e8119692b79"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:30 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] validate_networks() for [('40223427-597e-4817-ab9c-7e8119692b79', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:20:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting quotas for project aa21be0383ba4cab992ec2b897e763f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting quotas for user e5c31630bdcb497da65f928490c26948 and project aa21be0383ba4cab992ec2b897e763f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:20:31 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:20:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.164847 Apr 14 14:20:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 71/224] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:20:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:20:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5db745e6-65d8-4f73-9b6f-4e9ffcb63feb tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:31 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5db745e6-65d8-4f73-9b6f-4e9ffcb63feb tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:31 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-5db745e6-65d8-4f73-9b6f-4e9ffcb63feb tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5db745e6-65d8-4f73-9b6f-4e9ffcb63feb tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" status: 200 len: 1211 microversion: 2.1 time: 0.135290 Apr 14 14:20:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:31 2023] GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:35 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae", "tag": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:35 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:35 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:35 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:35 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Creating event network-changed:fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae on user Apr 14 14:20:35 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045161 Apr 14 14:20:35 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 80/226] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:38 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae", "name": "network-vif-plugged", "status": "completed", "tag": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:38 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Creating event network-vif-plugged:fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae on user Apr 14 14:20:38 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035383 Apr 14 14:20:38 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 72/227] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae", "name": "network-vif-plugged", "status": "completed", "tag": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Creating event network-vif-plugged:fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae on user Apr 14 14:20:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039481 Apr 14 14:20:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 76/228] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] HTTP exception thrown: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Request method failure captured: Apr 14 14:20:42 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d HTTP/1.1 Apr 14 14:20:42 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:20:42 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:20:42 user devstack@n-api.service[61718]: Connection: close Apr 14 14:20:42 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:20:42 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:20:42 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:20:42 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:20:42 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBpKMet9_4ApN-sACA1y2qwf20pPpjhSwFsYQNGyuQHiNP-coR8nFVN-H7g8cDjI1x5A3Gf0cKuXuyuHYBuACt5PPmwQhpztm7hvwXhGnmaPuw1z2QoJ9FPmzN9sh0_NAJYRbFuxndx0zaRfkA1BxcP6iFcfbMKx3O8zI04IPrTmYs Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Project-Id: 8f3e6748a8ce4ef0b22e272d19f6f584 Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Tenant-Id: 8f3e6748a8ce4ef0b22e272d19f6f584 Apr 14 14:20:42 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:42 user devstack@n-api.service[61718]: X-User: tempest-AttachSCSIVolumeTestJSON-1519996642-project-member Apr 14 14:20:42 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:20:42 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:20:42 user devstack@n-api.service[61718]: X-User-Id: ac3c91ffc9fe4c2a8afa04820908165a Apr 14 14:20:42 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1519996642-project-member Apr 14 14:20:42 user devstack@n-api.service[61718]: method: > Apr 14 14:20:42 user devstack@n-api.service[61718]: exception: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:42 user devstack@n-api.service[61718]: action_args: {'id': '14af0eec-8afa-4d4f-bc6a-3b04ff163e5d'} Apr 14 14:20:42 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Returning 404 to user: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-4ede36d6-29d6-4fe7-9b87-20f0bea5ee00 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 404 len: 111 microversion: 2.1 time: 0.032258 Apr 14 14:20:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 81/229] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:42 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:20:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-3d9cef40-d119-4500-824d-efbd00b44dda tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '.version_select at 0x7f67e41c9870>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-3d9cef40-d119-4500-824d-efbd00b44dda tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781102291" status: 202 len: 0 microversion: 2.1 time: 0.037941 Apr 14 14:20:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 73/230] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:20:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781102291 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:43 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8c522b1a-d906-4ce5-95c1-374ec16073bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1503 microversion: 2.1 time: 0.408695 Apr 14 14:20:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 77/231] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:42 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8ae8358d-c5a5-41b6-8811-a8c1aec6f117 tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-instance-actions/req-13dc0677-72ca-4934-967a-682a276b5684" status: 200 len: 503 microversion: 2.49 time: 0.050430 Apr 14 14:20:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 82/232] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 14:20:45 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-instance-actions/req-13dc0677-72ca-4934-967a-682a276b5684 => generated 503 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e0a90c0a-af40-4d6f-a1c1-2186e483d2ec tempest-TaggedAttachmentsTest-940397182 tempest-TaggedAttachmentsTest-940397182-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-instance-actions/req-13dc0677-72ca-4934-967a-682a276b5684" status: 200 len: 503 microversion: 2.49 time: 0.101505 Apr 14 14:20:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 74/233] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 14:20:45 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-instance-actions/req-13dc0677-72ca-4934-967a-682a276b5684 => generated 503 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5b7c647a-3c01-47e7-8600-057b4b9b404c tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.047814 Apr 14 14:20:45 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 78/234] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 14:20:45 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:20:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 204 len: 0 microversion: 2.49 time: 0.133444 Apr 14 14:20:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 83/235] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:20:45 2023] DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a36e6b02-e0e7-4492-9790-b3a412ee6247 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 200 len: 1753 microversion: 2.49 time: 0.366388 Apr 14 14:20:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 75/236] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:20:45 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 1753 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 14:20:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-unplugged", "status": "completed", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Creating event network-vif-unplugged:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:20:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041383 Apr 14 14:20:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 79/237] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] HTTP exception thrown: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Request method failure captured: Apr 14 14:20:46 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d HTTP/1.1 Apr 14 14:20:46 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:20:46 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:20:46 user devstack@n-api.service[61718]: Connection: close Apr 14 14:20:46 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:20:46 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:20:46 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:20:46 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:20:46 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBpKMet9_4ApN-sACA1y2qwf20pPpjhSwFsYQNGyuQHiNP-coR8nFVN-H7g8cDjI1x5A3Gf0cKuXuyuHYBuACt5PPmwQhpztm7hvwXhGnmaPuw1z2QoJ9FPmzN9sh0_NAJYRbFuxndx0zaRfkA1BxcP6iFcfbMKx3O8zI04IPrTmYs Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Project-Id: 8f3e6748a8ce4ef0b22e272d19f6f584 Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Tenant-Id: 8f3e6748a8ce4ef0b22e272d19f6f584 Apr 14 14:20:46 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:46 user devstack@n-api.service[61718]: X-User: tempest-AttachSCSIVolumeTestJSON-1519996642-project-member Apr 14 14:20:46 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:20:46 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:20:46 user devstack@n-api.service[61718]: X-User-Id: ac3c91ffc9fe4c2a8afa04820908165a Apr 14 14:20:46 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1519996642-project-member Apr 14 14:20:46 user devstack@n-api.service[61718]: method: > Apr 14 14:20:46 user devstack@n-api.service[61718]: exception: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61718]: action_args: {'id': '14af0eec-8afa-4d4f-bc6a-3b04ff163e5d'} Apr 14 14:20:46 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Returning 404 to user: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0908ddc2-63ed-4b63-a64c-d9e8119e8360 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 404 len: 111 microversion: 2.1 time: 0.033258 Apr 14 14:20:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 84/238] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:20:46 2023] DELETE /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] HTTP exception thrown: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Request method failure captured: Apr 14 14:20:46 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d HTTP/1.1 Apr 14 14:20:46 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:20:46 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:20:46 user devstack@n-api.service[61717]: Connection: close Apr 14 14:20:46 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:20:46 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:20:46 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:20:46 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:20:46 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBpKMet9_4ApN-sACA1y2qwf20pPpjhSwFsYQNGyuQHiNP-coR8nFVN-H7g8cDjI1x5A3Gf0cKuXuyuHYBuACt5PPmwQhpztm7hvwXhGnmaPuw1z2QoJ9FPmzN9sh0_NAJYRbFuxndx0zaRfkA1BxcP6iFcfbMKx3O8zI04IPrTmYs Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Project-Id: 8f3e6748a8ce4ef0b22e272d19f6f584 Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f3e6748a8ce4ef0b22e272d19f6f584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Tenant-Id: 8f3e6748a8ce4ef0b22e272d19f6f584 Apr 14 14:20:46 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1519996642 Apr 14 14:20:46 user devstack@n-api.service[61717]: X-User: tempest-AttachSCSIVolumeTestJSON-1519996642-project-member Apr 14 14:20:46 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:20:46 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:20:46 user devstack@n-api.service[61717]: X-User-Id: ac3c91ffc9fe4c2a8afa04820908165a Apr 14 14:20:46 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1519996642-project-member Apr 14 14:20:46 user devstack@n-api.service[61717]: method: > Apr 14 14:20:46 user devstack@n-api.service[61717]: exception: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61717]: action_args: {'id': '14af0eec-8afa-4d4f-bc6a-3b04ff163e5d'} Apr 14 14:20:46 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. Apr 14 14:20:46 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:20:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Returning 404 to user: Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:20:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-464c000d-02cd-4356-bee3-a108f433eec6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" status: 404 len: 111 microversion: 2.1 time: 0.047784 Apr 14 14:20:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 76/239] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:46 2023] GET /compute/v2.1/servers/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 14:20:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-deleted", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] Creating event network-vif-deleted:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:20:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037197 Apr 14 14:20:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 80/240] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a", "name": "network-vif-plugged", "status": "completed", "tag": "93ca09be-6bf7-49fb-873a-b3236618a784"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Creating event network-vif-plugged:93ca09be-6bf7-49fb-873a-b3236618a784 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a on user Apr 14 14:20:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044368 Apr 14 14:20:48 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 85/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-79f903d9-3a4e-4fd3-bd56-8e69473c08ef tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'create', calling method: .version_select at 0x7f67e41c8310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2096424138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-79f903d9-3a4e-4fd3-bd56-8e69473c08ef tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for project 1df398dd4f844286b41ee4948001013a. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-79f903d9-3a4e-4fd3-bd56-8e69473c08ef tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for user 19dad04c158549c39991ea05fca2531d and project 1df398dd4f844286b41ee4948001013a. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-79f903d9-3a4e-4fd3-bd56-8e69473c08ef tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047455 Apr 14 14:20:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 77/242] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:20:50 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:20:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-482352325", "imageRef": "2cb83aa4-680b-4b06-9ae7-13ba22013082", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2096424138", "networks": [{"uuid": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 204 len: 0 microversion: 2.1 time: 0.133028 Apr 14 14:20:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 81/243] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:20:50 2023] DELETE /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:50 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] validate_networks() for [('3e6dc6fc-92d7-4a9c-a3d4-6314555e6096', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:50 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1ec337a5-4317-44dd-9591-e0164bf67f7f tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 200 len: 1500 microversion: 2.1 time: 0.257535 Apr 14 14:20:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 78/244] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:50 2023] GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 1500 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40364b4-9668-45e3-8d72-d6e49ebb0147", "name": "network-vif-unplugged", "status": "completed", "tag": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Creating event network-vif-unplugged:dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance f40364b4-9668-45e3-8d72-d6e49ebb0147 on user Apr 14 14:20:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029469 Apr 14 14:20:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for project 1df398dd4f844286b41ee4948001013a. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for user 19dad04c158549c39991ea05fca2531d and project 1df398dd4f844286b41ee4948001013a. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:20:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2cb83aa4-680b-4b06-9ae7-13ba22013082',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:20:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.253937 Apr 14 14:20:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 86/246] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:20:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:20:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-160e8c8e-5fc6-41c5-85ea-e8b41e6ff3bb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-160e8c8e-5fc6-41c5-85ea-e8b41e6ff3bb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:51 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-160e8c8e-5fc6-41c5-85ea-e8b41e6ff3bb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-160e8c8e-5fc6-41c5-85ea-e8b41e6ff3bb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1252 microversion: 2.1 time: 0.083410 Apr 14 14:20:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 79/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:51 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1252 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40364b4-9668-45e3-8d72-d6e49ebb0147", "name": "network-vif-deleted", "tag": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] Creating event network-vif-deleted:dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance f40364b4-9668-45e3-8d72-d6e49ebb0147 on user Apr 14 14:20:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045749 Apr 14 14:20:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40364b4-9668-45e3-8d72-d6e49ebb0147", "name": "network-vif-plugged", "status": "completed", "tag": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Creating event network-vif-plugged:dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance f40364b4-9668-45e3-8d72-d6e49ebb0147 on user Apr 14 14:20:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040992 Apr 14 14:20:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 87/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c8a5f79c-f7d2-48dc-b7ac-45767d567372 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Action: 'create', calling method: .version_select at 0x7f67e41cb2e0>, body: {"keypair": {"name": "tempest-keypair-43486218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:54 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-c8a5f79c-f7d2-48dc-b7ac-45767d567372 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting quotas for project 5faf23277b174ab3aee69e7367a22285. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:20:54 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-c8a5f79c-f7d2-48dc-b7ac-45767d567372 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting quotas for user 0bf24630a76646a5b12bec32478b1325 and project 5faf23277b174ab3aee69e7367a22285. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:20:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c8a5f79c-f7d2-48dc-b7ac-45767d567372 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.046388 Apr 14 14:20:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 80/250] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 14:20:54 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 14:20:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Creating event network-changed:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:20:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Apr 14 14:20:55 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 84/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-190254133", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "19bd0998-e23e-41f1-bb89-e2b88e524bac"}, {"port": "a5f92228-fbae-4d8e-8663-327bff5c0992", "tag": "port-1"}, {"port": "bb36f103-c9d3-48be-b171-19ad5e290b03", "tag": "port-2"}, {"uuid": "0c19db67-7587-4968-a2fb-31685a84ca9b", "tag": "net-1"}, {"uuid": "0c19db67-7587-4968-a2fb-31685a84ca9b"}, {"uuid": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0cdacc83-d836-4efd-8100-713d62776570", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3eeadcfc-c90f-42a8-ac27-59c55a64e640", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7402d269-0492-44df-b3b6-44553ce0eb8d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1641821899"}], "key_name": "tempest-keypair-43486218", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:56 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] validate_networks() for [('19bd0998-e23e-41f1-bb89-e2b88e524bac', None, None, None, None, None), (None, None, 'a5f92228-fbae-4d8e-8663-327bff5c0992', None, None, None), (None, None, 'bb36f103-c9d3-48be-b171-19ad5e290b03', None, None, None), ('0c19db67-7587-4968-a2fb-31685a84ca9b', None, None, None, None, None), ('0c19db67-7587-4968-a2fb-31685a84ca9b', None, None, None, None, None), ('7b76c4dc-f0a5-4364-99b1-104a1bd68288', '10.2.2.100', None, None, None, None), ('7b76c4dc-f0a5-4364-99b1-104a1bd68288', '10.2.2.200', None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-plugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Creating event network-vif-plugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:20:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058565 Apr 14 14:20:59 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 81/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:20:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting quotas for project 5faf23277b174ab3aee69e7367a22285. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting quotas for user 0bf24630a76646a5b12bec32478b1325 and project 5faf23277b174ab3aee69e7367a22285. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5a7ddd66-fa49-4eb5-a0a6-a7a6537b04c8 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1657 microversion: 2.1 time: 0.338137 Apr 14 14:20:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:20:59 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1657 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc7bcb89-d102-4f4c-a94f-677aed86e109"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:20:59 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0cdacc83-d836-4efd-8100-713d62776570',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3eeadcfc-c90f-42a8-ac27-59c55a64e640',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7402d269-0492-44df-b3b6-44553ce0eb8d',volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:20:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:20:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.328355 Apr 14 14:20:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 88/254] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 14:20:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 3330 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6e5ae56c-596f-4082-869b-df6d8d215e92 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6e5ae56c-596f-4082-869b-df6d8d215e92 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:20:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343172 Apr 14 14:20:59 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 82/255] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:20:59 2023] POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-6e5ae56c-596f-4082-869b-df6d8d215e92 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-6e5ae56c-596f-4082-869b-df6d8d215e92 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:59 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-6e5ae56c-596f-4082-869b-df6d8d215e92 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:20:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6e5ae56c-596f-4082-869b-df6d8d215e92 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 200 len: 1277 microversion: 2.32 time: 0.103319 Apr 14 14:20:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:20:59 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-efa92403-3a96-401f-9ce8-b1adb49b42cb tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051942 Apr 14 14:21:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 89/257] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:21:00 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:21:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a" status: 204 len: 0 microversion: 2.1 time: 0.119537 Apr 14 14:21:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 83/258] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:21:00 2023] DELETE /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54c4c3585e74670adcb025cf9331844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9855c5aa444fb8c1636fda0b2f394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-51f7c543-ed56-447b-a1d8-f7e3cc0e7f3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a" status: 200 len: 1648 microversion: 2.1 time: 0.334095 Apr 14 14:21:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:00 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a => generated 1648 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "name": "network-vif-unplugged", "status": "completed", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Creating event network-vif-unplugged:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:21:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031232 Apr 14 14:21:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 90/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-plugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Creating event network-vif-plugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:21:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053791 Apr 14 14:21:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 84/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "name": "network-vif-plugged", "status": "completed", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}, {"server_uuid": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "name": "network-vif-deleted", "tag": "53a43ee4-c532-49fb-b441-84020cd63e8a"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Creating event network-vif-plugged:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:21:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Creating event network-vif-deleted:53a43ee4-c532-49fb-b441-84020cd63e8a for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a on user Apr 14 14:21:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035990 Apr 14 14:21:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] HTTP exception thrown: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Request method failure captured: Apr 14 14:21:03 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac HTTP/1.1 Apr 14 14:21:03 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:21:03 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:21:03 user devstack@n-api.service[61718]: Connection: close Apr 14 14:21:03 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:21:03 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:21:03 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:21:03 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:21:03 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBhVQDiDx5AmHqYIw6yPdlFLPpljolX2tGCyZL_TR_FbnBsbIYKEUev7RqVsc6d6jkjJoOW3e2zvbSg8QG9fGIukauLZPEFvcN0RHC-RS6SgkNPid9De__tUB_Xtq_vqZWJpG24YQBPQUgPNaLhmK2EMxOPffZCk_ADCuKi3VxGgF4 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Project-Id: 1da7ba7bdb124c3880e3394d3bbab296 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Tenant-Id: 1da7ba7bdb124c3880e3394d3bbab296 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:03 user devstack@n-api.service[61718]: X-User: tempest-TaggedBootDevicesTest_v242-1582702370-project-member Apr 14 14:21:03 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:21:03 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:21:03 user devstack@n-api.service[61718]: X-User-Id: c520c20d1b9f43dc8bf2517dffd76bea Apr 14 14:21:03 user devstack@n-api.service[61718]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1582702370-project-member Apr 14 14:21:03 user devstack@n-api.service[61718]: method: > Apr 14 14:21:03 user devstack@n-api.service[61718]: exception: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:03 user devstack@n-api.service[61718]: action_args: {'id': '56967036-c176-4423-aa3e-c78ee4e364ac'} Apr 14 14:21:03 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:03 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Returning 404 to user: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-66a24118-f35c-4825-8bb6-e925adff2535 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 404 len: 111 microversion: 2.42 time: 0.043626 Apr 14 14:21:03 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 91/263] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:21:03 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:21:03 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f0a95978-bbb4-4457-8640-6fd227bf7dca tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '.version_select at 0x7f67dff2b0a0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f0a95978-bbb4-4457-8640-6fd227bf7dca tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171371252" status: 204 len: 0 microversion: 2.42 time: 0.030007 Apr 14 14:21:03 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 85/264] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 14:21:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171371252 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5d0026e2-186b-4e40-a8b8-e113d0a9665b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: .version_select at 0x7f67e418ff40>, body: {"keypair": {"name": "tempest-keypair-1691574866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXMBsx3tZ/pzA7pUesoxz20+s2PMIuu1p4YtORcW2KZpbK+XTk1V1E55dx88s1tlWtpe92mIcpEdZncR+F3HkdmfxQm3HyfeSnI5mqOcypLulfxZXvv2e/JzrsDckWZQA=="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-5d0026e2-186b-4e40-a8b8-e113d0a9665b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-5d0026e2-186b-4e40-a8b8-e113d0a9665b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:21:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5d0026e2-186b-4e40-a8b8-e113d0a9665b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123291 Apr 14 14:21:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 89/265] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:21:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] HTTP exception thrown: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Request method failure captured: Apr 14 14:21:07 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac HTTP/1.1 Apr 14 14:21:07 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:21:07 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:21:07 user devstack@n-api.service[61717]: Connection: close Apr 14 14:21:07 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:21:07 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:21:07 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:21:07 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:21:07 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBhVQDiDx5AmHqYIw6yPdlFLPpljolX2tGCyZL_TR_FbnBsbIYKEUev7RqVsc6d6jkjJoOW3e2zvbSg8QG9fGIukauLZPEFvcN0RHC-RS6SgkNPid9De__tUB_Xtq_vqZWJpG24YQBPQUgPNaLhmK2EMxOPffZCk_ADCuKi3VxGgF4 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Project-Id: 1da7ba7bdb124c3880e3394d3bbab296 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Tenant-Id: 1da7ba7bdb124c3880e3394d3bbab296 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:07 user devstack@n-api.service[61717]: X-User: tempest-TaggedBootDevicesTest_v242-1582702370-project-member Apr 14 14:21:07 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:21:07 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:21:07 user devstack@n-api.service[61717]: X-User-Id: c520c20d1b9f43dc8bf2517dffd76bea Apr 14 14:21:07 user devstack@n-api.service[61717]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1582702370-project-member Apr 14 14:21:07 user devstack@n-api.service[61717]: method: > Apr 14 14:21:07 user devstack@n-api.service[61717]: exception: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61717]: action_args: {'id': '56967036-c176-4423-aa3e-c78ee4e364ac'} Apr 14 14:21:07 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Returning 404 to user: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-245f3fef-e106-4d5c-8c81-3333a0c4a84a tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 404 len: 111 microversion: 2.42 time: 0.047791 Apr 14 14:21:07 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 86/266] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:21:07 2023] DELETE /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] HTTP exception thrown: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Request method failure captured: Apr 14 14:21:07 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac HTTP/1.1 Apr 14 14:21:07 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:21:07 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:21:07 user devstack@n-api.service[61716]: Connection: close Apr 14 14:21:07 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:21:07 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:21:07 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:21:07 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:21:07 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBhVQDiDx5AmHqYIw6yPdlFLPpljolX2tGCyZL_TR_FbnBsbIYKEUev7RqVsc6d6jkjJoOW3e2zvbSg8QG9fGIukauLZPEFvcN0RHC-RS6SgkNPid9De__tUB_Xtq_vqZWJpG24YQBPQUgPNaLhmK2EMxOPffZCk_ADCuKi3VxGgF4 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Project-Id: 1da7ba7bdb124c3880e3394d3bbab296 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1da7ba7bdb124c3880e3394d3bbab296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Tenant-Id: 1da7ba7bdb124c3880e3394d3bbab296 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1582702370 Apr 14 14:21:07 user devstack@n-api.service[61716]: X-User: tempest-TaggedBootDevicesTest_v242-1582702370-project-member Apr 14 14:21:07 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:21:07 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:21:07 user devstack@n-api.service[61716]: X-User-Id: c520c20d1b9f43dc8bf2517dffd76bea Apr 14 14:21:07 user devstack@n-api.service[61716]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1582702370-project-member Apr 14 14:21:07 user devstack@n-api.service[61716]: method: > Apr 14 14:21:07 user devstack@n-api.service[61716]: exception: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61716]: action_args: {'id': '56967036-c176-4423-aa3e-c78ee4e364ac'} Apr 14 14:21:07 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. Apr 14 14:21:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Returning 404 to user: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2e7b8b08-e519-4312-89be-a7cc3d8d4a63 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac" status: 404 len: 111 microversion: 2.42 time: 0.031404 Apr 14 14:21:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 90/267] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:21:07 2023] GET /compute/v2.1/servers/56967036-c176-4423-aa3e-c78ee4e364ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:21:08 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f8bd9401-7fc2-4f4f-85f4-49f56b505a57 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1703 microversion: 2.1 time: 0.625637 Apr 14 14:21:08 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 92/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:07 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1703 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1012026360", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: dict_keys(['metadata_items']) {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: dict_keys(['metadata_items']) {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/action" status: 202 len: 1160 microversion: 2.1 time: 0.368197 Apr 14 14:21:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 87/269] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 14:21:08 2023] POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/action => generated 1160 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:08 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8a69ff27-d98c-4e1e-87e8-44ac8b0c1c13 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1732 microversion: 2.1 time: 0.318859 Apr 14 14:21:08 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 91/270] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:08 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1732 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-136108581", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "788caf36-1098-4d17-b6c9-0a12d0019dca"}], "security_groups": [{"name": "tempest-securitygroup--645325890"}], "key_name": "tempest-keypair-1691574866", "user_data": "}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:09 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] validate_networks() for [('788caf36-1098-4d17-b6c9-0a12d0019dca', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:21:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=12 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:09 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Creating event network-changed:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045875 Apr 14 14:21:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 88/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "056480e9-af67-44cc-962d-bff93d69382d"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-eb2ddc2e-404c-49bb-8d56-f03c4636ae80 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.430872 Apr 14 14:21:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 92/272] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 14:21:10 2023] POST /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments => generated 188 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61717) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 14:21:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/action" status: 202 len: 0 microversion: 2.20 time: 0.121865 Apr 14 14:21:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 89/273] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:21:10 2023] POST /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:21:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:21:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.896285 Apr 14 14:21:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 93/274] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:21:09 2023] POST /compute/v2.1/servers => generated 399 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-fa72709f-277d-4649-b559-c66d81b71422 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fa72709f-277d-4649-b559-c66d81b71422 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:11 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-fa72709f-277d-4649-b559-c66d81b71422 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-fa72709f-277d-4649-b559-c66d81b71422 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 200 len: 1235 microversion: 2.1 time: 0.086837 Apr 14 14:21:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 90/275] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:10 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:11 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:11 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:11 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ea371b96-8933-4454-b97f-5988901b629c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1737 microversion: 2.20 time: 0.392289 Apr 14 14:21:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:21:10 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1737 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:21:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}, {"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}, {"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "a5f92228-fbae-4d8e-8663-327bff5c0992"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Creating event network-vif-unplugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:21:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:21:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Creating event network-changed:a5f92228-fbae-4d8e-8663-327bff5c0992 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.047083 Apr 14 14:21:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 94/277] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:13 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "bb36f103-c9d3-48be-b171-19ad5e290b03"}, {"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:13 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Creating event network-changed:bb36f103-c9d3-48be-b171-19ad5e290b03 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Creating event network-changed:5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048140 Apr 14 14:21:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 91/278] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:13 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:14 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:14 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Creating event network-changed:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:21:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043215 Apr 14 14:21:14 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 94/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "441450e6-f5c3-49e5-a923-8fe63e779f1f"}, {"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "4d2eefbe-0a0c-4746-ad92-71766e028a0f"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Creating event network-changed:441450e6-f5c3-49e5-a923-8fe63e779f1f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Creating event network-changed:4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030894 Apr 14 14:21:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 95/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:15 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:17 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "name": "network-vif-plugged", "status": "completed", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:17 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Creating event network-vif-plugged:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:21:17 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038999 Apr 14 14:21:17 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 92/281] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:17 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:18 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "70dcece2-b0b6-411e-aece-4c6552fb9331"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:18 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Creating event network-changed:70dcece2-b0b6-411e-aece-4c6552fb9331 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:18 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035147 Apr 14 14:21:18 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:19 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "name": "network-vif-plugged", "status": "completed", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Creating event network-vif-plugged:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:21:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 Apr 14 14:21:19 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 96/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:20 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:20 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:20 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:20 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:20 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Creating event network-changed:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:21:20 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034798 Apr 14 14:21:20 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 93/284] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:21 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1c24e495-4b3a-4690-841e-0a34f2440aef tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" status: 200 len: 1495 microversion: 2.1 time: 0.287057 Apr 14 14:21:21 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:21 2023] GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => generated 1495 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:27 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:27 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:27 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:21:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079737 Apr 14 14:21:27 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 97/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:29 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:29 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:29 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:29 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:29 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:29 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:21:29 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040153 Apr 14 14:21:29 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 94/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:30 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Creating event network-vif-plugged:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045959 Apr 14 14:21:30 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "a5f92228-fbae-4d8e-8663-327bff5c0992"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:31 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:31 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=26 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Creating event network-vif-plugged:a5f92228-fbae-4d8e-8663-327bff5c0992 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070624 Apr 14 14:21:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 98/289] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "bb36f103-c9d3-48be-b171-19ad5e290b03"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Creating event network-vif-plugged:bb36f103-c9d3-48be-b171-19ad5e290b03 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054255 Apr 14 14:21:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 95/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:21:32 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}, {"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-plugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}, {"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-plugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Creating event network-vif-plugged:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Creating event network-vif-plugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:21:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Creating event network-vif-plugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:21:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Creating event network-vif-plugged:5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:32 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.071459 Apr 14 14:21:32 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 98/291] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "a5f92228-fbae-4d8e-8663-327bff5c0992"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Creating event network-vif-plugged:a5f92228-fbae-4d8e-8663-327bff5c0992 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039110 Apr 14 14:21:33 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 99/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "bb36f103-c9d3-48be-b171-19ad5e290b03"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "441450e6-f5c3-49e5-a923-8fe63e779f1f"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "441450e6-f5c3-49e5-a923-8fe63e779f1f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:33 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Creating event network-vif-plugged:bb36f103-c9d3-48be-b171-19ad5e290b03 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Creating event network-vif-plugged:441450e6-f5c3-49e5-a923-8fe63e779f1f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Creating event network-vif-plugged:441450e6-f5c3-49e5-a923-8fe63e779f1f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.045642 Apr 14 14:21:33 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 96/293] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "4d2eefbe-0a0c-4746-ad92-71766e028a0f"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "4d2eefbe-0a0c-4746-ad92-71766e028a0f"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "70dcece2-b0b6-411e-aece-4c6552fb9331"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "70dcece2-b0b6-411e-aece-4c6552fb9331"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Creating event network-vif-plugged:5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Creating event network-vif-plugged:4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Creating event network-vif-plugged:4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Creating event network-vif-plugged:70dcece2-b0b6-411e-aece-4c6552fb9331 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Creating event network-vif-plugged:70dcece2-b0b6-411e-aece-4c6552fb9331 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:21:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.051161 Apr 14 14:21:34 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] HTTP exception thrown: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Request method failure captured: Apr 14 14:21:36 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a HTTP/1.1 Apr 14 14:21:36 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:21:36 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:21:36 user devstack@n-api.service[61718]: Connection: close Apr 14 14:21:36 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:21:36 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:21:36 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:21:36 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:21:36 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBiAf-LgCu1PIp9nDIyodjAYeC4EVcwjI2KV8QyJejOF5uQC0oOD_zi8htcvjxNmv44Xw89DvWI0vwMkJXnEejftO3U2jS9Yaqfur5EddvfRI8syirDc6rACcFFn04ecaWmB1qZbttBSD3YBtDKy9Z_sbTGu-JcO_aaGQ0UphmioK8 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Project-Id: d6bca3db8fa34f948a25621d348995f4 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Project-Name: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Tenant: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Tenant-Id: d6bca3db8fa34f948a25621d348995f4 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-User: tempest-TaggedAttachmentsTest-804560801-project-member Apr 14 14:21:36 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:21:36 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:21:36 user devstack@n-api.service[61718]: X-User-Id: ec166aaa170041c1a486379c7f417e66 Apr 14 14:21:36 user devstack@n-api.service[61718]: X-User-Name: tempest-TaggedAttachmentsTest-804560801-project-member Apr 14 14:21:36 user devstack@n-api.service[61718]: method: > Apr 14 14:21:36 user devstack@n-api.service[61718]: exception: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:36 user devstack@n-api.service[61718]: action_args: {'id': 'dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a'} Apr 14 14:21:36 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Returning 404 to user: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9ba1cb66-79bb-4fcf-870c-bc9c48edde50 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 404 len: 111 microversion: 2.49 time: 0.051604 Apr 14 14:21:36 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 100/295] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:21:36 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:21:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c9abd454-08f1-4645-b21f-46021a5c4a74 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '.version_select at 0x7f67dffd6050>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c9abd454-08f1-4645-b21f-46021a5c4a74 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679569523" status: 204 len: 0 microversion: 2.49 time: 0.041160 Apr 14 14:21:36 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 97/296] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 14:21:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679569523 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] HTTP exception thrown: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Request method failure captured: Apr 14 14:21:39 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a HTTP/1.1 Apr 14 14:21:39 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:21:39 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:21:39 user devstack@n-api.service[61716]: Connection: close Apr 14 14:21:39 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:21:39 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:21:39 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:21:39 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:21:39 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBiAf-LgCu1PIp9nDIyodjAYeC4EVcwjI2KV8QyJejOF5uQC0oOD_zi8htcvjxNmv44Xw89DvWI0vwMkJXnEejftO3U2jS9Yaqfur5EddvfRI8syirDc6rACcFFn04ecaWmB1qZbttBSD3YBtDKy9Z_sbTGu-JcO_aaGQ0UphmioK8 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Project-Id: d6bca3db8fa34f948a25621d348995f4 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Project-Name: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Tenant: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Tenant-Id: d6bca3db8fa34f948a25621d348995f4 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-User: tempest-TaggedAttachmentsTest-804560801-project-member Apr 14 14:21:39 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:21:39 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:21:39 user devstack@n-api.service[61716]: X-User-Id: ec166aaa170041c1a486379c7f417e66 Apr 14 14:21:39 user devstack@n-api.service[61716]: X-User-Name: tempest-TaggedAttachmentsTest-804560801-project-member Apr 14 14:21:39 user devstack@n-api.service[61716]: method: > Apr 14 14:21:39 user devstack@n-api.service[61716]: exception: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61716]: action_args: {'id': 'dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a'} Apr 14 14:21:39 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Returning 404 to user: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a4ad672a-d2bb-4fd3-8e44-19c47b5892e3 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 404 len: 111 microversion: 2.49 time: 0.037651 Apr 14 14:21:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 100/297] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:21:39 2023] DELETE /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] HTTP exception thrown: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Request method failure captured: Apr 14 14:21:39 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a HTTP/1.1 Apr 14 14:21:39 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:21:39 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:21:39 user devstack@n-api.service[61718]: Connection: close Apr 14 14:21:39 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:21:39 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:21:39 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:21:39 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:21:39 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBiAf-LgCu1PIp9nDIyodjAYeC4EVcwjI2KV8QyJejOF5uQC0oOD_zi8htcvjxNmv44Xw89DvWI0vwMkJXnEejftO3U2jS9Yaqfur5EddvfRI8syirDc6rACcFFn04ecaWmB1qZbttBSD3YBtDKy9Z_sbTGu-JcO_aaGQ0UphmioK8 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Project-Id: d6bca3db8fa34f948a25621d348995f4 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Project-Name: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d6bca3db8fa34f948a25621d348995f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Tenant: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Tenant-Id: d6bca3db8fa34f948a25621d348995f4 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TaggedAttachmentsTest-804560801 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-User: tempest-TaggedAttachmentsTest-804560801-project-member Apr 14 14:21:39 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:21:39 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:21:39 user devstack@n-api.service[61718]: X-User-Id: ec166aaa170041c1a486379c7f417e66 Apr 14 14:21:39 user devstack@n-api.service[61718]: X-User-Name: tempest-TaggedAttachmentsTest-804560801-project-member Apr 14 14:21:39 user devstack@n-api.service[61718]: method: > Apr 14 14:21:39 user devstack@n-api.service[61718]: exception: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61718]: action_args: {'id': 'dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a'} Apr 14 14:21:39 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. Apr 14 14:21:39 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:21:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Returning 404 to user: Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-fe9d0639-bda9-4f33-9f01-5032da8eb20f tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" status: 404 len: 111 microversion: 2.49 time: 0.039488 Apr 14 14:21:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 101/298] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:21:39 2023] GET /compute/v2.1/servers/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] HTTP exception thrown: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Request method failure captured: Apr 14 14:21:40 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 HTTP/1.1 Apr 14 14:21:40 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:21:40 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:21:40 user devstack@n-api.service[61717]: Connection: close Apr 14 14:21:40 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:21:40 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:21:40 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:21:40 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:21:40 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBghrnWKhC_DlZCkE1y1ACbAE1XEqwKBxd4tP62sUc0RVPfTMTeffBrLtrlZSL1JOYJCEW_zuobTFgUbAKt3EUXW-d6WTZHLOZiXEvDMvhW1Hsh2_YcwjNd6IDWwZseeB5bXSONjLCPhtR8OGnwbCe2WQWJOweFhsZyWj8-LBZP20k Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Project-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08dbbd3691924823b98d44b11508019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Tenant: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Tenant-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:21:40 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:21:40 user devstack@n-api.service[61717]: X-User: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:21:40 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:21:40 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:21:40 user devstack@n-api.service[61717]: X-User-Id: a609ae82102a4ec994823e59f1a37378 Apr 14 14:21:40 user devstack@n-api.service[61717]: X-User-Name: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:21:40 user devstack@n-api.service[61717]: method: > Apr 14 14:21:40 user devstack@n-api.service[61717]: exception: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:21:40 user devstack@n-api.service[61717]: action_args: {'id': 'f40364b4-9668-45e3-8d72-d6e49ebb0147'} Apr 14 14:21:40 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:21:40 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:21:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Returning 404 to user: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4c061d61-c19c-4bf2-bcc8-eee5a6a761b4 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 404 len: 111 microversion: 2.1 time: 0.055518 Apr 14 14:21:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 98/299] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:40 2023] GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:41 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-33836ce1-b4af-4b82-9f60-aec1b46be613 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1494 microversion: 2.1 time: 0.436642 Apr 14 14:21:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:40 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1494 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d78f2de7-7497-4efa-ad5a-92b68a7c64c6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1536 microversion: 2.1 time: 1.153099 Apr 14 14:21:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 102/301] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:41 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1536 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-21a27b63-0e8e-43f6-9c98-9e772593f892 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Action: 'create', calling method: .version_select at 0x7f67dffd76d0>, body: {"keypair": {"name": "tempest-keypair-1665568620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG6CGdcPTxnc20cAT09PWltwZ9dV2VmciF9n8/6ntZku9choOWtWjG4TaYyDwwi97Q7GgJIEVXlDOgWGZq3YI+oL07LY/8GN78RAWAGwVdDlzGqza6dkL5xCOnG2giNA=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:45 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-21a27b63-0e8e-43f6-9c98-9e772593f892 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting quotas for project 08b661ed41a346a487e0b47ce2c2af13. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:21:45 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-21a27b63-0e8e-43f6-9c98-9e772593f892 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting quotas for user f64d891eb758466888e7ca9550994511 and project 08b661ed41a346a487e0b47ce2c2af13. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:21:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-21a27b63-0e8e-43f6-9c98-9e772593f892 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171369 Apr 14 14:21:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 99/302] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:21:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=18 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:46 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:21:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/action" status: 200 len: 32 microversion: 2.1 time: 0.148835 Apr 14 14:21:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 102/303] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:21:46 2023] POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:46 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f2f3f80f-faf5-444b-b180-a6d70436e12d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1509 microversion: 2.1 time: 0.646117 Apr 14 14:21:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 103/304] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:46 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1509 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-393140121", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "eebad641-c9f2-4ff8-8655-6019ac289951"}], "security_groups": [{"name": "tempest-securitygroup--1579000019"}], "key_name": "tempest-keypair-1665568620", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] validate_networks() for [('eebad641-c9f2-4ff8-8655-6019ac289951', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting quotas for project 08b661ed41a346a487e0b47ce2c2af13. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting quotas for user f64d891eb758466888e7ca9550994511 and project 08b661ed41a346a487e0b47ce2c2af13. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:21:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:21:47 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.891134 Apr 14 14:21:47 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 100/305] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:21:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:21:47 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4e3feafe-14fb-4359-9ff3-7cc828999326 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:48 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4e3feafe-14fb-4359-9ff3-7cc828999326 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-unplugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:48 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-4e3feafe-14fb-4359-9ff3-7cc828999326 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Creating event network-vif-unplugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:21:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032042 Apr 14 14:21:48 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 104/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4e3feafe-14fb-4359-9ff3-7cc828999326 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1239 microversion: 2.1 time: 0.106056 Apr 14 14:21:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:47 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:21:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046206 Apr 14 14:21:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 105/308] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:50 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:50 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:50 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6013c77e-4b60-4698-983b-459dad27502e tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 200 len: 2823 microversion: 2.32 time: 0.682321 Apr 14 14:21:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 101/309] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:21:49 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 2823 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] HTTP exception thrown: Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a could not be found. Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Request method failure captured: Apr 14 14:21:50 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a HTTP/1.1 Apr 14 14:21:50 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:21:50 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:21:50 user devstack@n-api.service[61716]: Connection: close Apr 14 14:21:50 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:21:50 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:21:50 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:21:50 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:21:50 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBW0-e6ITJoiE1-TMIPXLsx0VUbHpwAZbQreDtXE46iuc3LLyN9zCuQ2oNCrwZIH-C2rhvstJfyULWE_fouMn7NPnaSmcVM3pcGsT3go87woX7IWl8h4VDbvIhAEppoM6N-ENdv9Yx08Ldz85giQNJzOmoh4AONDPGBtdX94kNOGPk Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Project-Id: aab9855c5aa444fb8c1636fda0b2f394 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestVolumeSwap-306457705 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aab9855c5aa444fb8c1636fda0b2f394"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aab9855c5aa444fb8c1636fda0b2f394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aab9855c5aa444fb8c1636fda0b2f394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Tenant: tempest-TestVolumeSwap-306457705 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Tenant-Id: aab9855c5aa444fb8c1636fda0b2f394 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestVolumeSwap-306457705 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-User: tempest-TestVolumeSwap-306457705-project-member Apr 14 14:21:50 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:21:50 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:21:50 user devstack@n-api.service[61716]: X-User-Id: d54c4c3585e74670adcb025cf9331844 Apr 14 14:21:50 user devstack@n-api.service[61716]: X-User-Name: tempest-TestVolumeSwap-306457705-project-member Apr 14 14:21:50 user devstack@n-api.service[61716]: method: > Apr 14 14:21:50 user devstack@n-api.service[61716]: exception: Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a could not be found. Apr 14 14:21:50 user devstack@n-api.service[61716]: action_args: {'id': '4d417e09-6e54-4cad-91e5-7910ee4e784a'} Apr 14 14:21:50 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a could not be found. Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a could not be found. Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a could not be found. Apr 14 14:21:50 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:21:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Returning 404 to user: Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:21:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-46a41fb1-60f1-40b2-8550-24906e0c749a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a" status: 404 len: 111 microversion: 2.1 time: 0.037088 Apr 14 14:21:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:50 2023] GET /compute/v2.1/servers/4d417e09-6e54-4cad-91e5-7910ee4e784a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:21:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d90d99e7-5c6f-4840-a65e-8af7748e7b3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Calling method '.version_select at 0x7f67e42d7a30>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d90d99e7-5c6f-4840-a65e-8af7748e7b3d tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-557766472" status: 202 len: 0 microversion: 2.1 time: 0.023480 Apr 14 14:21:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 106/311] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 14:21:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-557766472 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:21:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Creating event network-changed:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:21:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027286 Apr 14 14:21:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 102/312] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}, {"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:21:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:21:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037954 Apr 14 14:21:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:21:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146717 Apr 14 14:21:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 107/314] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:21:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:21:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048729 Apr 14 14:21:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 103/315] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:21:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:21:59 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:21:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8e2bb4d3-5f31-43ba-bd84-2613c18da492 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1723 microversion: 2.1 time: 0.679524 Apr 14 14:21:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:21:59 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1723 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:01 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d226ce18-dadb-4a9a-9937-17d620262e9a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1782 microversion: 2.20 time: 0.637908 Apr 14 14:22:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 104/317] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:22:01 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1782 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:22:02 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:02 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=30 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:02 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-780fa56d-7fcc-422b-849e-9eb36f687a75 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 200 len: 1543 microversion: 2.1 time: 1.081565 Apr 14 14:22:02 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 108/318] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:01 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 1543 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-0ff9503c-42a0-4a45-9afc-80bc73b0714c tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: .version_select at 0x7f67e4426a70>, body: {"keypair": {"name": "tempest-keypair-1819910287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg=="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:02 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-0ff9503c-42a0-4a45-9afc-80bc73b0714c tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:22:02 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-0ff9503c-42a0-4a45-9afc-80bc73b0714c tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for user 303cb0475ae74f328ee503d1e9d1f652 and project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:22:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-0ff9503c-42a0-4a45-9afc-80bc73b0714c tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093879 Apr 14 14:22:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 107/319] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:22:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:05 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-398425278", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e74c25a5-d089-40ed-9f3f-6d838da07564"}], "security_groups": [{"name": "tempest-securitygroup--755667710"}], "key_name": "tempest-keypair-1819910287", "user_data": "}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:05 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] validate_networks() for [('e74c25a5-d089-40ed-9f3f-6d838da07564', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=22 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for user 303cb0475ae74f328ee503d1e9d1f652 and project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:22:06 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:22:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.443519 Apr 14 14:22:06 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 105/320] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:22:05 2023] POST /compute/v2.1/servers => generated 399 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:22:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b1f2bec7-fb53-4d44-8963-957f5cb0f8e9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:06 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b1f2bec7-fb53-4d44-8963-957f5cb0f8e9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:06 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:06 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-b1f2bec7-fb53-4d44-8963-957f5cb0f8e9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b1f2bec7-fb53-4d44-8963-957f5cb0f8e9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1231 microversion: 2.1 time: 0.082562 Apr 14 14:22:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 109/321] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:06 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1231 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:10 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=9 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ea4c2d1d-735a-4efc-a478-afefd4e7177a tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Action: 'create', calling method: .version_select at 0x7f67dff012d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-941852943", "metadata": {"Type": "work"}}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Creating event network-changed:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:22:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031647 Apr 14 14:22:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 106/322] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ea4c2d1d-735a-4efc-a478-afefd4e7177a tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.507827 Apr 14 14:22:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 108/323] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 14:22:10 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 509 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 14:22:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e8346fd5-161c-42ad-83dd-99aafa41d2f8 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67e42d40d0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e8346fd5-161c-42ad-83dd-99aafa41d2f8 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 352 microversion: 2.1 time: 0.063058 Apr 14 14:22:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 110/324] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:10 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:22:11 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e9f68343-d2b0-45dd-8104-ddbbac1a7ab6 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67dffd6710>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e9f68343-d2b0-45dd-8104-ddbbac1a7ab6 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 352 microversion: 2.1 time: 0.077368 Apr 14 14:22:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 107/325] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:11 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:12 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:22:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089385 Apr 14 14:22:12 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ca95c87f-0ed2-4a15-8375-6607506cf036 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67dffbe290>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ca95c87f-0ed2-4a15-8375-6607506cf036 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 353 microversion: 2.1 time: 0.052573 Apr 14 14:22:13 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 111/327] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:12 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:13 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-cbea24df-dfef-43ad-954d-1b5bde2c7e54 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67dfe45870>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-cbea24df-dfef-43ad-954d-1b5bde2c7e54 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 353 microversion: 2.1 time: 0.051928 Apr 14 14:22:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 108/328] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:13 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:13 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:13 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-accea0d7-3975-486e-b236-16b97998f77e tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67e418fac0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-accea0d7-3975-486e-b236-16b97998f77e tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 202 len: 0 microversion: 2.1 time: 0.064071 Apr 14 14:22:13 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:22:13 2023] DELETE /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:22:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ccf102e7-8b0c-4995-bffa-45e109bdf183 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67e44f1ab0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ccf102e7-8b0c-4995-bffa-45e109bdf183 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 352 microversion: 2.1 time: 0.063255 Apr 14 14:22:13 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 112/330] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:13 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-85081eff-7ace-41e7-bec2-57d82e92f879 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67e41cb6d0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-85081eff-7ace-41e7-bec2-57d82e92f879 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 352 microversion: 2.1 time: 0.050854 Apr 14 14:22:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 109/331] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:14 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:14 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:22:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028331 Apr 14 14:22:14 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 111/332] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7582021b-6946-476f-b92d-21a85aea5661 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67e43a7be0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-7582021b-6946-476f-b92d-21a85aea5661 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 200 len: 352 microversion: 2.1 time: 0.051674 Apr 14 14:22:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 113/333] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:15 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-236e8de5-8f73-4536-892f-4dd9e7434130 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Calling method '.version_select at 0x7f67dff2add0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-236e8de5-8f73-4536-892f-4dd9e7434130 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] HTTP exception thrown: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. Apr 14 14:22:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-236e8de5-8f73-4536-892f-4dd9e7434130 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Request method failure captured: Apr 14 14:22:16 user devstack@n-api.service[61717]: request: GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d HTTP/1.1 Apr 14 14:22:16 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:22:16 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:22:16 user devstack@n-api.service[61717]: Connection: close Apr 14 14:22:16 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:22:16 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:22:16 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:22:16 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:22:16 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWGScapFT6XasGbM67nrL_ghO37tfI1f-DfEy0Dk3g8t1O3C3HZ4EYG-3Z7dMzJ1O0kpUMFB7ZqmNPchiXlz0ylntyVa_VRRviVOhmtm5YpAUVfeIeE9NhwGhwPrefvJGQ86wvb2bqfgZWhsRWYvj76JuJXKHVosJmTxrrMfRaEMKIM Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Project-Id: fcee1a52b5954f73ba61b428e03f031e Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Project-Name: tempest-VolumesGetTestJSON-1142223604 Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcee1a52b5954f73ba61b428e03f031e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcee1a52b5954f73ba61b428e03f031e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcee1a52b5954f73ba61b428e03f031e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Tenant: tempest-VolumesGetTestJSON-1142223604 Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Tenant-Id: fcee1a52b5954f73ba61b428e03f031e Apr 14 14:22:16 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-VolumesGetTestJSON-1142223604 Apr 14 14:22:16 user devstack@n-api.service[61717]: X-User: tempest-VolumesGetTestJSON-1142223604-project-member Apr 14 14:22:16 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:22:16 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:22:16 user devstack@n-api.service[61717]: X-User-Id: 8b7ab41e8be7402bbfcbaaa61abdadb4 Apr 14 14:22:16 user devstack@n-api.service[61717]: X-User-Name: tempest-VolumesGetTestJSON-1142223604-project-member Apr 14 14:22:16 user devstack@n-api.service[61717]: method: Apr 14 14:22:16 user devstack@n-api.service[61717]: exception: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. Apr 14 14:22:16 user devstack@n-api.service[61717]: action_args: {'id': '3decc9fe-fa80-42de-9547-5243686b054d'} Apr 14 14:22:16 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. (HTTP 404) (Request-ID: req-e6cfc1e9-5306-4079-a785-d4943fd45baa) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. Apr 14 14:22:16 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-236e8de5-8f73-4536-892f-4dd9e7434130 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] Returning 404 to user: Volume 3decc9fe-fa80-42de-9547-5243686b054d could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:22:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-236e8de5-8f73-4536-892f-4dd9e7434130 tempest-VolumesGetTestJSON-1142223604 tempest-VolumesGetTestJSON-1142223604-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d" status: 404 len: 109 microversion: 2.1 time: 0.038139 Apr 14 14:22:16 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 110/334] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:22:16 2023] GET /compute/v2.1/os-volumes/3decc9fe-fa80-42de-9547-5243686b054d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "434ae4c2-1084-4dc3-b76d-3e4e9603a4fd"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] HTTP exception thrown: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Request method failure captured: Apr 14 14:22:24 user devstack@n-api.service[61716]: request: PUT /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/os-volume_attachments/db6fad8d-b6d1-422e-8fa6-727c273ebb49 HTTP/1.1 Apr 14 14:22:24 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:22:24 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:22:24 user devstack@n-api.service[61716]: Connection: close Apr 14 14:22:24 user devstack@n-api.service[61716]: Content-Length: 74 Apr 14 14:22:24 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:22:24 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:22:24 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:22:24 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWB030ECMEEF4kz-zus4dhCXJkhL5m1UGhsx19fG8A4frOUp-PGTMNBMciuVHq0F9kl6MOwjfcvb-W3aV4hmIII2W9wZZf_PhmB_kTsa_Cuds8JWrnEnyRyOXcVZLTQyerD_KhI7u6V-nFL7ECHr3_elbUQt_hOJhvgQZa-gixSNCAg Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Project-Id: 6a51e590acc648fda0320f09f1525b83 Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesAdminNegativeTest-698490239 Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Role: member,admin,reader Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Roles: member,admin,reader Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a51e590acc648fda0320f09f1525b83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a51e590acc648fda0320f09f1525b83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a51e590acc648fda0320f09f1525b83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesAdminNegativeTest-698490239 Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Tenant-Id: 6a51e590acc648fda0320f09f1525b83 Apr 14 14:22:24 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-698490239 Apr 14 14:22:24 user devstack@n-api.service[61716]: X-User: tempest-VolumesAdminNegativeTest-698490239-project-admin Apr 14 14:22:24 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:22:24 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:22:24 user devstack@n-api.service[61716]: X-User-Id: 1fc191b61c5f45eeaa2f00b34652075b Apr 14 14:22:24 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesAdminNegativeTest-698490239-project-admin Apr 14 14:22:24 user devstack@n-api.service[61716]: Apr 14 14:22:24 user devstack@n-api.service[61716]: {"volumeAttachment": {"volumeId": "434ae4c2-1084-4dc3-b76d-3e4e9603a4fd"}} Apr 14 14:22:24 user devstack@n-api.service[61716]: method: > Apr 14 14:22:24 user devstack@n-api.service[61716]: exception: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. Apr 14 14:22:24 user devstack@n-api.service[61716]: action_args: {'server_id': 'c15d8ed4-3a4b-4c28-be6a-c311b72ecaae', 'id': 'db6fad8d-b6d1-422e-8fa6-727c273ebb49', 'body': {'volumeAttachment': {'volumeId': '434ae4c2-1084-4dc3-b76d-3e4e9603a4fd'}}} Apr 14 14:22:24 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. (HTTP 404) (Request-ID: req-d70eb4a7-67e0-415c-ab42-fae208b60216) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. Apr 14 14:22:24 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:22:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] Returning 404 to user: Volume db6fad8d-b6d1-422e-8fa6-727c273ebb49 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:22:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-06ed4b1b-390f-45e9-bbf4-86c61dba6ac4 tempest-VolumesAdminNegativeTest-698490239 tempest-VolumesAdminNegativeTest-698490239-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/os-volume_attachments/db6fad8d-b6d1-422e-8fa6-727c273ebb49" status: 404 len: 109 microversion: 2.1 time: 0.111042 Apr 14 14:22:24 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 112/335] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 14:22:24 2023] PUT /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/os-volume_attachments/db6fad8d-b6d1-422e-8fa6-727c273ebb49 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:22:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" status: 204 len: 0 microversion: 2.1 time: 0.123041 Apr 14 14:22:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 114/336] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:22:28 2023] DELETE /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:28 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0ad2a87f-c6ad-4e90-87ec-23e60a0a96bd tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" status: 200 len: 1501 microversion: 2.1 time: 0.270813 Apr 14 14:22:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 111/337] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:28 2023] GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 14:22:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae", "name": "network-vif-unplugged", "status": "completed", "tag": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Creating event network-vif-unplugged:fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae on user Apr 14 14:22:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172637 Apr 14 14:22:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 113/338] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:29 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae", "name": "network-vif-deleted", "tag": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] Creating event network-vif-deleted:fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae on user Apr 14 14:22:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162666 Apr 14 14:22:29 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 115/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae", "name": "network-vif-plugged", "status": "completed", "tag": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Creating event network-vif-plugged:fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae on user Apr 14 14:22:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034667 Apr 14 14:22:30 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 112/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:37 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f86a6795-ab31-4f7a-acbc-f810837b24be tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1489 microversion: 2.1 time: 0.487561 Apr 14 14:22:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:36 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1489 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:38 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f8405b9f-933f-44be-9cf6-5f9a67998bba tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1552 microversion: 2.1 time: 0.273975 Apr 14 14:22:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 116/342] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:38 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1552 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:43 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5929f4db-67e0-468e-a285-509f5984726a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1536 microversion: 2.1 time: 0.257437 Apr 14 14:22:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 113/343] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:42 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1536 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Searching by: {'deleted': False, 'project_id': '1df398dd4f844286b41ee4948001013a'} {{(pid=61716) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:43 user devstack@n-api.service[61716]: DEBUG nova.compute.multi_cell_list [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 14:22:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bcb6bb5a-4ca8-4400-b63e-30cd61623e3f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.189674 Apr 14 14:22:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 14:22:43 2023] GET /compute/v2.1/servers => generated 340 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:43 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-29e994fc-a7a2-42b8-86bf-04a8e1a8d102 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1536 microversion: 2.1 time: 0.214043 Apr 14 14:22:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:43 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1536 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f40766e1-da07-4bcc-8357-3c9518a8aa90 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416294042", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a2561367-2af3-4ba8-9917-bb8f9fcee8a0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-f40766e1-da07-4bcc-8357-3c9518a8aa90 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] HTTP exception thrown: Block Device a2561367-2af3-4ba8-9917-bb8f9fcee8a0 is not bootable. Apr 14 14:22:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f40766e1-da07-4bcc-8357-3c9518a8aa90 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Request method failure captured: Apr 14 14:22:43 user devstack@n-api.service[61717]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 14:22:43 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:22:43 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:22:43 user devstack@n-api.service[61717]: Connection: close Apr 14 14:22:43 user devstack@n-api.service[61717]: Content-Length: 357 Apr 14 14:22:43 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:22:43 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:22:43 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:22:43 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBghrnWKhC_DlZCkE1y1ACbAE1XEqwKBxd4tP62sUc0RVPfTMTeffBrLtrlZSL1JOYJCEW_zuobTFgUbAKt3EUXW-d6WTZHLOZiXEvDMvhW1Hsh2_YcwjNd6IDWwZseeB5bXSONjLCPhtR8OGnwbCe2WQWJOweFhsZyWj8-LBZP20k Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Project-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08dbbd3691924823b98d44b11508019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Tenant: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Tenant-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:22:43 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:22:43 user devstack@n-api.service[61717]: X-User: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:22:43 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:22:43 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:22:43 user devstack@n-api.service[61717]: X-User-Id: a609ae82102a4ec994823e59f1a37378 Apr 14 14:22:43 user devstack@n-api.service[61717]: X-User-Name: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:22:43 user devstack@n-api.service[61717]: Apr 14 14:22:43 user devstack@n-api.service[61717]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416294042", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a2561367-2af3-4ba8-9917-bb8f9fcee8a0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2"}]}} Apr 14 14:22:43 user devstack@n-api.service[61717]: method: > Apr 14 14:22:43 user devstack@n-api.service[61717]: exception: Block Device a2561367-2af3-4ba8-9917-bb8f9fcee8a0 is not bootable. Apr 14 14:22:43 user devstack@n-api.service[61717]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1416294042', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a2561367-2af3-4ba8-9917-bb8f9fcee8a0'}], 'networks': [{'uuid': '6dbfb18b-1c4c-42fe-8597-3b57e05446a2'}]}}} Apr 14 14:22:43 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a2561367-2af3-4ba8-9917-bb8f9fcee8a0 is not bootable. Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:22:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a2561367-2af3-4ba8-9917-bb8f9fcee8a0 is not bootable. Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a2561367-2af3-4ba8-9917-bb8f9fcee8a0 is not bootable. Apr 14 14:22:44 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:22:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f40766e1-da07-4bcc-8357-3c9518a8aa90 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Returning 400 to user: Block Device a2561367-2af3-4ba8-9917-bb8f9fcee8a0 is not bootable. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:22:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f40766e1-da07-4bcc-8357-3c9518a8aa90 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.091846 Apr 14 14:22:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 114/346] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:22:43 2023] POST /compute/v2.1/servers => generated 110 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:44 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a8ccb7f5-8847-4629-b215-a9346b07a394 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1494 microversion: 2.1 time: 0.281281 Apr 14 14:22:44 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 116/347] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:44 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1494 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0591f14c-b6cc-477c-833e-ddb91e7bd431"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297669 Apr 14 14:22:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 118/348] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:22:46 2023] POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-047ed181-499c-4314-ac34-d09d45de078a tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.371083 Apr 14 14:22:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 115/349] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:22:50 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62/os-interface => generated 1830 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:22:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Creating event network-changed:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029026 Apr 14 14:22:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 117/350] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-be60133b-065c-41a5-8824-6d799b64c7bc tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 200 len: 2823 microversion: 2.32 time: 0.644621 Apr 14 14:22:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 119/351] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:22:52 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 2823 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5198b2ad-d1bc-4b25-a6c5-e963f335aad9 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.131838 Apr 14 14:22:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 116/352] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:22:52 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62/os-interface => generated 1830 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:22:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 204 len: 0 microversion: 2.32 time: 0.125641 Apr 14 14:22:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 118/353] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:22:54 2023] DELETE /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9317a571-3858-4fa0-a863-db586225d7ae tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 200 len: 2948 microversion: 2.32 time: 0.251087 Apr 14 14:22:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 120/354] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:22:54 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 2948 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:22:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Creating event network-vif-unplugged:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035255 Apr 14 14:22:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 117/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "a5f92228-fbae-4d8e-8663-327bff5c0992"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Creating event network-vif-unplugged:a5f92228-fbae-4d8e-8663-327bff5c0992 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052483 Apr 14 14:22:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 119/356] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "bb36f103-c9d3-48be-b171-19ad5e290b03"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Creating event network-vif-unplugged:bb36f103-c9d3-48be-b171-19ad5e290b03 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037139 Apr 14 14:22:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 121/357] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "4d2eefbe-0a0c-4746-ad92-71766e028a0f"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "4d2eefbe-0a0c-4746-ad92-71766e028a0f"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "70dcece2-b0b6-411e-aece-4c6552fb9331"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "70dcece2-b0b6-411e-aece-4c6552fb9331"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-plugged:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-unplugged:5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-plugged:5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-unplugged:4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-plugged:4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-unplugged:70dcece2-b0b6-411e-aece-4c6552fb9331 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Creating event network-vif-plugged:70dcece2-b0b6-411e-aece-4c6552fb9331 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.035291 Apr 14 14:22:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 118/358] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 14:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:56 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "a5f92228-fbae-4d8e-8663-327bff5c0992"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:56 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:56 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Creating event network-vif-plugged:a5f92228-fbae-4d8e-8663-327bff5c0992 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036779 Apr 14 14:22:56 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 120/359] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "bb36f103-c9d3-48be-b171-19ad5e290b03"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-unplugged", "status": "completed", "tag": "441450e6-f5c3-49e5-a923-8fe63e779f1f"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-plugged", "status": "completed", "tag": "441450e6-f5c3-49e5-a923-8fe63e779f1f"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Creating event network-vif-plugged:bb36f103-c9d3-48be-b171-19ad5e290b03 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Creating event network-vif-unplugged:441450e6-f5c3-49e5-a923-8fe63e779f1f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Creating event network-vif-plugged:441450e6-f5c3-49e5-a923-8fe63e779f1f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:22:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.046416 Apr 14 14:22:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 122/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:57 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-bf6c3825-07c4-4026-9847-238b86eb9426 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1536 microversion: 2.1 time: 0.323653 Apr 14 14:22:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 119/361] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:56 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1536 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:58 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:22:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a8987d9f-6a21-4614-9b70-761c918a3a68 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1582 microversion: 2.1 time: 0.220518 Apr 14 14:22:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 121/362] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:57 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1582 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:22:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:22:59 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:59 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:22:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Creating event network-changed:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:22:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047844 Apr 14 14:22:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 123/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:22:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:00 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ff32f795-1198-4db0-b061-9399db176a61 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1723 microversion: 2.1 time: 0.251132 Apr 14 14:23:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 120/364] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:22:59 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:00 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-544b70a8-f9c8-4673-b280-6c3ef9452440 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1723 microversion: 2.1 time: 0.357072 Apr 14 14:23:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 122/365] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:00 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1723 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-deleted", "tag": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] Creating event network-vif-deleted:5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:23:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054823 Apr 14 14:23:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 124/366] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-983098674"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:01 user devstack@n-api.service[61717]: INFO nova.network.security_group_api [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Adding security group e73f55a4-3a41-44bd-82ce-228ba9be6888 to port cc694601-d879-4214-ac40-2242faaec5bf Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-436e7218-a421-4e8d-82f7-81ffe046803e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments/056480e9-af67-44cc-962d-bff93d69382d" status: 200 len: 194 microversion: 2.20 time: 0.257435 Apr 14 14:23:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 123/367] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 14:23:01 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments/056480e9-af67-44cc-962d-bff93d69382d => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-79368188-452b-49f5-96a5-4b3c58c2e9a7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/action" status: 202 len: 0 microversion: 2.1 time: 0.755960 Apr 14 14:23:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 121/368] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:23:01 2023] POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'services' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments/056480e9-af67-44cc-962d-bff93d69382d" status: 202 len: 0 microversion: 2.20 time: 0.169244 Apr 14 14:23:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 124/369] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 14:23:02 2023] DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments/056480e9-af67-44cc-962d-bff93d69382d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-104f4a21-0036-4ebe-b0db-2b9f5237f1a5 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1746 microversion: 2.1 time: 0.170810 Apr 14 14:23:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:02 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Creating event network-changed:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038225 Apr 14 14:23:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-33b52ed7-a19e-4c28-a920-29a16bedd702 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068129 Apr 14 14:23:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 123/372] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 14:23:02 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e239f2ac-54c1-4045-b907-2b4382e2414c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.345014 Apr 14 14:23:02 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 125/373] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:23:02 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-interface => generated 282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-deleted", "tag": "5c8947cd-1a82-4092-bb65-17dcd80ec71e"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-deleted", "tag": "4d2eefbe-0a0c-4746-ad92-71766e028a0f"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] Creating event network-vif-deleted:5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] Creating event network-vif-deleted:4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:23:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035729 Apr 14 14:23:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:23:04 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Creating event network-changed:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:23:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040433 Apr 14 14:23:04 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 124/375] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:04 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5e8e195e-f266-4466-89f7-01a9be279403 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/ips" status: 200 len: 107 microversion: 2.1 time: 0.037914 Apr 14 14:23:04 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:23:04 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/ips => generated 107 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:04 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-deleted", "tag": "70dcece2-b0b6-411e-aece-4c6552fb9331"}, {"server_uuid": "ed499196-32c8-4f77-92af-f84ed0a2cd62", "name": "network-vif-deleted", "tag": "441450e6-f5c3-49e5-a923-8fe63e779f1f"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] Creating event network-vif-deleted:70dcece2-b0b6-411e-aece-4c6552fb9331 for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:23:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] Creating event network-vif-deleted:441450e6-f5c3-49e5-a923-8fe63e779f1f for instance ed499196-32c8-4f77-92af-f84ed0a2cd62 on user Apr 14 14:23:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029947 Apr 14 14:23:04 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 127/377] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/action" status: 202 len: 0 microversion: 2.1 time: 0.088351 Apr 14 14:23:07 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 125/378] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:23:07 2023] POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:07 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0d9d9527-ac20-4c3b-9960-a87b7f5ccd1f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1748 microversion: 2.1 time: 0.254232 Apr 14 14:23:07 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:07 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1748 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8f8a6ce-1a76-4c0b-909c-96ff91ba5696"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354267 Apr 14 14:23:08 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 128/380] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:23:07 2023] POST /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:23:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-unplugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Creating event network-vif-unplugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:23:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028762 Apr 14 14:23:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-plugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Creating event network-vif-plugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:23:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Apr 14 14:23:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:12 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-plugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Creating event network-vif-plugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:23:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030149 Apr 14 14:23:12 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 129/383] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-plugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:14 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=29 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:14 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Creating event network-vif-plugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:23:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048803 Apr 14 14:23:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 127/384] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-31c841ca-015c-408c-aacc-82391555eaf8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: .version_select at 0x7f67e42d4d30>, body: {"keypair": {"name": "tempest-keypair-630351444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESnavlENNjfXDBBjXZH0TsbH9EKMFE+T6Mpv2iIokkBQmdhZm5u1mpWFB6kBhDC2cGq5kV6NVzXAe9L+Fdg5KFHQcqHOskojjP9fpyzYiJBlhppafU1+xltOvvYIodn/w=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:15 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-31c841ca-015c-408c-aacc-82391555eaf8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:23:15 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-31c841ca-015c-408c-aacc-82391555eaf8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:23:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-31c841ca-015c-408c-aacc-82391555eaf8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049139 Apr 14 14:23:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:23:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2116395706", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "788caf36-1098-4d17-b6c9-0a12d0019dca"}], "security_groups": [{"name": "tempest-securitygroup--2014488634"}], "key_name": "tempest-keypair-630351444", "user_data": "}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:17 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] validate_networks() for [('788caf36-1098-4d17-b6c9-0a12d0019dca', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:23:18 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:18 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] HTTP exception thrown: Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae could not be found. Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Request method failure captured: Apr 14 14:23:18 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae HTTP/1.1 Apr 14 14:23:18 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:23:18 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:23:18 user devstack@n-api.service[61717]: Connection: close Apr 14 14:23:18 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:23:18 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:23:18 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:23:18 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:23:18 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBaSSvX4SuWxukIAhT7-tRngr__kzuMHi7Q-1LnVGLb_4GQoykDggrrx10_k0i362O27nNNcCjpiT8MJCve9grCVKK_kCFxRn3Y6PHUvseXWUDr8uay6lOxvqeMrJg3Qk3Jo4ypdSgmHmJHIiayW6JcqePCe0phO-DeJDwg-CSwW-4 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Project-Id: aa21be0383ba4cab992ec2b897e763f4 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Project-Name: tempest-VolumesAdminNegativeTest-1341751798 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa21be0383ba4cab992ec2b897e763f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa21be0383ba4cab992ec2b897e763f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aa21be0383ba4cab992ec2b897e763f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Tenant: tempest-VolumesAdminNegativeTest-1341751798 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Tenant-Id: aa21be0383ba4cab992ec2b897e763f4 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1341751798 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-User: tempest-VolumesAdminNegativeTest-1341751798-project-member Apr 14 14:23:18 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:23:18 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:23:18 user devstack@n-api.service[61717]: X-User-Id: e5c31630bdcb497da65f928490c26948 Apr 14 14:23:18 user devstack@n-api.service[61717]: X-User-Name: tempest-VolumesAdminNegativeTest-1341751798-project-member Apr 14 14:23:18 user devstack@n-api.service[61717]: method: > Apr 14 14:23:18 user devstack@n-api.service[61717]: exception: Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae could not be found. Apr 14 14:23:18 user devstack@n-api.service[61717]: action_args: {'id': 'c15d8ed4-3a4b-4c28-be6a-c311b72ecaae'} Apr 14 14:23:18 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae could not be found. Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae could not be found. Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae could not be found. Apr 14 14:23:18 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Returning 404 to user: Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:23:18 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.784762 Apr 14 14:23:18 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8c290bb7-e912-4744-9a07-a8529a93a499 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" status: 404 len: 111 microversion: 2.1 time: 0.041775 Apr 14 14:23:18 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 130/386] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:23:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:23:18 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 128/387] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:18 2023] GET /compute/v2.1/servers/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:23:18 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1ea27a0a-60d3-40ea-9fe8-cd97a6060af4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:18 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1ea27a0a-60d3-40ea-9fe8-cd97a6060af4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:18 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-1ea27a0a-60d3-40ea-9fe8-cd97a6060af4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1ea27a0a-60d3-40ea-9fe8-cd97a6060af4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 200 len: 1235 microversion: 2.1 time: 0.073368 Apr 14 14:23:18 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 130/388] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:18 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:21 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Creating event network-changed:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:23:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030253 Apr 14 14:23:21 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 131/389] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:21 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:23:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e" status: 204 len: 0 microversion: 2.1 time: 0.120748 Apr 14 14:23:21 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 129/390] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:23:21 2023] DELETE /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=19 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:22 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:22 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a28ec549-ed94-439b-b0f4-830d131fa529 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e" status: 200 len: 1670 microversion: 2.1 time: 0.370529 Apr 14 14:23:22 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 131/391] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:21 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e => generated 1670 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "name": "network-vif-unplugged", "status": "completed", "tag": "513e9086-658d-44df-962e-3a4f16649083"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Creating event network-vif-unplugged:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:23:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048819 Apr 14 14:23:22 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 132/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:24 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "name": "network-vif-deleted", "tag": "513e9086-658d-44df-962e-3a4f16649083"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] Creating event network-vif-deleted:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:23:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038482 Apr 14 14:23:24 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 130/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:24 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc70d475-20dd-4859-a6fe-d2d09341799e", "name": "network-vif-plugged", "status": "completed", "tag": "513e9086-658d-44df-962e-3a4f16649083"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Creating event network-vif-plugged:513e9086-658d-44df-962e-3a4f16649083 for instance bc70d475-20dd-4859-a6fe-d2d09341799e on user Apr 14 14:23:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 Apr 14 14:23:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-plugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}, {"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-plugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Creating event network-vif-plugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:23:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Creating event network-vif-plugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:23:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028589 Apr 14 14:23:26 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 133/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5432e605-99b2-405f-b4a2-368f2cb50c26"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 while it is in vm_state rescued Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Request method failure captured: Apr 14 14:23:37 user devstack@n-api.service[61717]: request: POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/os-volume_attachments HTTP/1.1 Apr 14 14:23:37 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:23:37 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:23:37 user devstack@n-api.service[61717]: Connection: close Apr 14 14:23:37 user devstack@n-api.service[61717]: Content-Length: 74 Apr 14 14:23:37 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:23:37 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:23:37 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:23:37 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBXzt78mFb8M3WWyp5BElUs3FxeYswY_G-byiClO1Ijhc9Ynmxu-dJA2BitefQNaaca8H_XNXfynEEuWJEc6y-_887v3iJjyNGVfuHYJKdKo-YNZBufoVreeU1iVR-XUREPKlJBt0Jkkx_8FwgbR0wBt6TXN-kLqEcZUfcIxALmmLg Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Project-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Tenant-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:23:37 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:23:37 user devstack@n-api.service[61717]: X-User: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:23:37 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:23:37 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:23:37 user devstack@n-api.service[61717]: X-User-Id: cdfcb787b0f545f8b19e947d54d07b9c Apr 14 14:23:37 user devstack@n-api.service[61717]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:23:37 user devstack@n-api.service[61717]: Apr 14 14:23:37 user devstack@n-api.service[61717]: {"volumeAttachment": {"volumeId": "5432e605-99b2-405f-b4a2-368f2cb50c26"}} Apr 14 14:23:37 user devstack@n-api.service[61717]: method: > Apr 14 14:23:37 user devstack@n-api.service[61717]: exception: Cannot 'attach_volume' instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 while it is in vm_state rescued Apr 14 14:23:37 user devstack@n-api.service[61717]: action_args: {'server_id': '30643f90-4347-4b1e-b1ca-57e69e716fb4', 'body': {'volumeAttachment': {'volumeId': '5432e605-99b2-405f-b4a2-368f2cb50c26'}}} Apr 14 14:23:37 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 while it is in vm_state rescued Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 while it is in vm_state rescued Apr 14 14:23:37 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Returning 409 to user: Cannot 'attach_volume' instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 while it is in vm_state rescued {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:23:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-94e6a25c-ec89-476c-9691-00d1847feb27 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048533 Apr 14 14:23:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 131/396] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:23:37 2023] POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/action" status: 202 len: 0 microversion: 2.1 time: 0.076996 Apr 14 14:23:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 133/397] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:23:37 2023] POST /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=7 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:38 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-606dbe5f-2bb8-4a78-99b1-322982b98333 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1497 microversion: 2.1 time: 0.426385 Apr 14 14:23:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 134/398] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:37 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1497 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:38 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e6533d9c-9bf6-4ae9-b025-02e6bda00eea tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.161772 Apr 14 14:23:38 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 132/399] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:23:38 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-interface => generated 282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-unplugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Creating event network-vif-unplugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:23:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029843 Apr 14 14:23:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 134/400] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Creating event network-changed:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:23:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045073 Apr 14 14:23:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 135/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1918839037"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/action" status: 202 len: 0 microversion: 2.1 time: 0.881778 Apr 14 14:23:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 133/402] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:23:39 2023] POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 14:23:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ad8e3601-df9a-41c2-b8d0-1d7d55ae372d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '.version_select at 0x7f67dffbfd00>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:40 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ad8e3601-df9a-41c2-b8d0-1d7d55ae372d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f" status: 200 len: 1609 microversion: 2.1 time: 0.070258 Apr 14 14:23:40 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 135/403] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 14:23:40 2023] GET /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f => generated 1609 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}, {"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:23:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:23:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030672 Apr 14 14:23:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 136/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:23:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 Apr 14 14:23:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 134/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] HTTP exception thrown: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Request method failure captured: Apr 14 14:23:44 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 HTTP/1.1 Apr 14 14:23:44 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:23:44 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:23:44 user devstack@n-api.service[61716]: Connection: close Apr 14 14:23:44 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:23:44 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:23:44 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:23:44 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:23:44 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWEtb7Up8A4W6XNv-SD0FWfi6pzPGDZ5ro2PIKgORAV0cmzSiJIv_R87J1ytorda4IHOaWrNnMkP5LJ5NOcHqGYZ00owZuc6yqg8G_U9JUnj3PnVEPottT-AmSEo7g25iSjU-oBcnXGhXdqsjsY0TSddq6zkv32gKJDYIcEIbt0d6YM Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Project-Id: 5faf23277b174ab3aee69e7367a22285 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Project-Name: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Tenant: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Tenant-Id: 5faf23277b174ab3aee69e7367a22285 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-User: tempest-TaggedBootDevicesTest-1246501284-project-member Apr 14 14:23:44 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:23:44 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:23:44 user devstack@n-api.service[61716]: X-User-Id: 0bf24630a76646a5b12bec32478b1325 Apr 14 14:23:44 user devstack@n-api.service[61716]: X-User-Name: tempest-TaggedBootDevicesTest-1246501284-project-member Apr 14 14:23:44 user devstack@n-api.service[61716]: method: > Apr 14 14:23:44 user devstack@n-api.service[61716]: exception: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:44 user devstack@n-api.service[61716]: action_args: {'id': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'} Apr 14 14:23:44 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Returning 404 to user: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:23:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-924412bc-ea31-416a-9c7b-527ef365c94b tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 404 len: 111 microversion: 2.32 time: 0.031053 Apr 14 14:23:44 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 137/406] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:23:44 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:23:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a0f210bf-cde8-4d7e-9526-3516afc4aac8 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '.version_select at 0x7f67dfe44b80>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a0f210bf-cde8-4d7e-9526-3516afc4aac8 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43486218" status: 204 len: 0 microversion: 2.32 time: 0.026799 Apr 14 14:23:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 135/407] 10.0.0.210 () {64 vars in 1333 bytes} [Fri Apr 14 14:23:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43486218 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:23:44 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:44 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c07db066-dfb8-4e27-9249-90088950b3d1 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1494 microversion: 2.1 time: 0.268622 Apr 14 14:23:44 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 136/408] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:44 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1494 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] HTTP exception thrown: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Request method failure captured: Apr 14 14:23:48 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 HTTP/1.1 Apr 14 14:23:48 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:23:48 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:23:48 user devstack@n-api.service[61716]: Connection: close Apr 14 14:23:48 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:23:48 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:23:48 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:23:48 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:23:48 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWEtb7Up8A4W6XNv-SD0FWfi6pzPGDZ5ro2PIKgORAV0cmzSiJIv_R87J1ytorda4IHOaWrNnMkP5LJ5NOcHqGYZ00owZuc6yqg8G_U9JUnj3PnVEPottT-AmSEo7g25iSjU-oBcnXGhXdqsjsY0TSddq6zkv32gKJDYIcEIbt0d6YM Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Project-Id: 5faf23277b174ab3aee69e7367a22285 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Project-Name: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Tenant: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Tenant-Id: 5faf23277b174ab3aee69e7367a22285 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-User: tempest-TaggedBootDevicesTest-1246501284-project-member Apr 14 14:23:48 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:23:48 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:23:48 user devstack@n-api.service[61716]: X-User-Id: 0bf24630a76646a5b12bec32478b1325 Apr 14 14:23:48 user devstack@n-api.service[61716]: X-User-Name: tempest-TaggedBootDevicesTest-1246501284-project-member Apr 14 14:23:48 user devstack@n-api.service[61716]: method: > Apr 14 14:23:48 user devstack@n-api.service[61716]: exception: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61716]: action_args: {'id': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'} Apr 14 14:23:48 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Returning 404 to user: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:23:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bf38693f-c7f6-4871-9222-92098bf299ce tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 404 len: 111 microversion: 2.32 time: 0.029745 Apr 14 14:23:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 138/409] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:23:48 2023] DELETE /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] HTTP exception thrown: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Request method failure captured: Apr 14 14:23:48 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 HTTP/1.1 Apr 14 14:23:48 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:23:48 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:23:48 user devstack@n-api.service[61717]: Connection: close Apr 14 14:23:48 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:23:48 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:23:48 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:23:48 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:23:48 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWEtb7Up8A4W6XNv-SD0FWfi6pzPGDZ5ro2PIKgORAV0cmzSiJIv_R87J1ytorda4IHOaWrNnMkP5LJ5NOcHqGYZ00owZuc6yqg8G_U9JUnj3PnVEPottT-AmSEo7g25iSjU-oBcnXGhXdqsjsY0TSddq6zkv32gKJDYIcEIbt0d6YM Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Project-Id: 5faf23277b174ab3aee69e7367a22285 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Project-Name: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5faf23277b174ab3aee69e7367a22285"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Tenant: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Tenant-Id: 5faf23277b174ab3aee69e7367a22285 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1246501284 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-User: tempest-TaggedBootDevicesTest-1246501284-project-member Apr 14 14:23:48 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:23:48 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:23:48 user devstack@n-api.service[61717]: X-User-Id: 0bf24630a76646a5b12bec32478b1325 Apr 14 14:23:48 user devstack@n-api.service[61717]: X-User-Name: tempest-TaggedBootDevicesTest-1246501284-project-member Apr 14 14:23:48 user devstack@n-api.service[61717]: method: > Apr 14 14:23:48 user devstack@n-api.service[61717]: exception: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61717]: action_args: {'id': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'} Apr 14 14:23:48 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. Apr 14 14:23:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:23:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Returning 404 to user: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:23:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-00fc2191-5fa0-4d01-b234-13eefe40c035 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62" status: 404 len: 111 microversion: 2.32 time: 0.028620 Apr 14 14:23:48 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 136/410] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:23:48 2023] GET /compute/v2.1/servers/ed499196-32c8-4f77-92af-f84ed0a2cd62 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-49b4e998-aee2-4a40-b79d-b1cef1db6d95 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057199 Apr 14 14:23:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 137/411] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 14:23:52 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:52 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:23:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 204 len: 0 microversion: 2.20 time: 0.137552 Apr 14 14:23:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 139/412] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:23:52 2023] DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:53 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-unplugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:53 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:53 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-cd58eed5-3d66-431f-9a1f-90e73ebd2bd8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 200 len: 1710 microversion: 2.20 time: 0.344018 Apr 14 14:23:53 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 137/413] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:23:52 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 1710 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:23:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Creating event network-vif-unplugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:23:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032163 Apr 14 14:23:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 138/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-plugged", "status": "completed", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}, {"server_uuid": "e81e92d6-b79e-46db-b69e-1f7584440287", "name": "network-vif-deleted", "tag": "839834af-8da2-4f1a-84c5-e0469c3679f5"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Creating event network-vif-plugged:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:23:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Creating event network-vif-deleted:839834af-8da2-4f1a-84c5-e0469c3679f5 for instance e81e92d6-b79e-46db-b69e-1f7584440287 on user Apr 14 14:23:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045347 Apr 14 14:23:55 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 140/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-78510527-2882-4811-b400-35f16a48eecc tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.188489 Apr 14 14:23:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 138/416] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:23:57 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-interface => generated 283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:57 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:23:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-efd9a11c-e102-4f7b-912d-b6577a4bd8b6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1746 microversion: 2.1 time: 0.305850 Apr 14 14:23:57 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:23:57 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1746 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:23:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:23:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Creating event network-changed:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:23:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073633 Apr 14 14:23:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 141/418] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:23:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:23:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:23:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e3bc2ff7-27f8-4755-9fc3-7facb941399a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/ips" status: 200 len: 104 microversion: 2.1 time: 0.039354 Apr 14 14:23:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 139/419] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:23:58 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/ips => generated 104 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:00 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'services' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:24:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments/fc7bcb89-d102-4f4c-a94f-677aed86e109" status: 202 len: 0 microversion: 2.1 time: 0.163488 Apr 14 14:24:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:24:00 2023] DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments/fc7bcb89-d102-4f4c-a94f-677aed86e109 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a5403dd6-9b6d-4970-8bef-59af106fcd4b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047335 Apr 14 14:24:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:24:00 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c4e8847-0aac-4a87-8a83-09a33dabcca1"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301744 Apr 14 14:24:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 140/422] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:24:00 2023] POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7667bafa-3d46-4dd6-922a-aa194efa01c6 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Action: 'create', calling method: .version_select at 0x7f67dfffb760>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-899357826", "metadata": {"Type": "work"}}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7667bafa-3d46-4dd6-922a-aa194efa01c6 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Request method failure captured: Apr 14 14:24:06 user devstack@n-api.service[61718]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 14:24:06 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:24:06 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:24:06 user devstack@n-api.service[61718]: Connection: close Apr 14 14:24:06 user devstack@n-api.service[61718]: Content-Length: 121 Apr 14 14:24:06 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:24:06 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:24:06 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:24:06 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWIGiqvDoWTVas1HE8AcfKWXdqS81nVaNWbvIILDoVKmGRgeLggqI6v8MsyXcUOCEkImv4oBTrJAab5Pj53iSoGwjhG9HZPP-xbpxYeeDa3C7itZHhr8i1oDBLsEAjPPmC6xnlaewfhZwFE96VMxfRAljfvf97RKR2ZkpwFRKIYa-y0 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Project-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Tenant-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-User: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:06 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:24:06 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:24:06 user devstack@n-api.service[61718]: X-User-Id: 7b2ae645c9e8423aa718e72294a89af1 Apr 14 14:24:06 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:06 user devstack@n-api.service[61718]: Apr 14 14:24:06 user devstack@n-api.service[61718]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-899357826", "metadata": {"Type": "work"}}} Apr 14 14:24:06 user devstack@n-api.service[61718]: method: Apr 14 14:24:06 user devstack@n-api.service[61718]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61718]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-899357826', 'metadata': {'Type': 'work'}}}} Apr 14 14:24:06 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise error Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7667bafa-3d46-4dd6-922a-aa194efa01c6 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-7667bafa-3d46-4dd6-922a-aa194efa01c6 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.327131 Apr 14 14:24:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 141/423] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 14:24:06 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:24:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2a4e2b77-b0a1-49e6-9517-ffcc94028cd5 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Action: 'create', calling method: .version_select at 0x7f67dff4c940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-695417619", "metadata": {"Type": "work"}}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2a4e2b77-b0a1-49e6-9517-ffcc94028cd5 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Request method failure captured: Apr 14 14:24:06 user devstack@n-api.service[61716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 14:24:06 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:24:06 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:24:06 user devstack@n-api.service[61716]: Connection: close Apr 14 14:24:06 user devstack@n-api.service[61716]: Content-Length: 119 Apr 14 14:24:06 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:24:06 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:24:06 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:24:06 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWIGiqvDoWTVas1HE8AcfKWXdqS81nVaNWbvIILDoVKmGRgeLggqI6v8MsyXcUOCEkImv4oBTrJAab5Pj53iSoGwjhG9HZPP-xbpxYeeDa3C7itZHhr8i1oDBLsEAjPPmC6xnlaewfhZwFE96VMxfRAljfvf97RKR2ZkpwFRKIYa-y0 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Project-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Tenant-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-User: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:06 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:24:06 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:24:06 user devstack@n-api.service[61716]: X-User-Id: 7b2ae645c9e8423aa718e72294a89af1 Apr 14 14:24:06 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:06 user devstack@n-api.service[61716]: Apr 14 14:24:06 user devstack@n-api.service[61716]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-695417619", "metadata": {"Type": "work"}}} Apr 14 14:24:06 user devstack@n-api.service[61716]: method: Apr 14 14:24:06 user devstack@n-api.service[61716]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 14:24:06 user devstack@n-api.service[61716]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-695417619', 'metadata': {'Type': 'work'}}}} Apr 14 14:24:06 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise error Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi '0' Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 14:24:06 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2a4e2b77-b0a1-49e6-9517-ffcc94028cd5 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:06 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2a4e2b77-b0a1-49e6-9517-ffcc94028cd5 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010360 Apr 14 14:24:06 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 143/424] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 14:24:06 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:24:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-316175a2-e86a-4634-9468-6a5c28c94f72 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Action: 'create', calling method: .version_select at 0x7f67e429f760>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1479075485", "metadata": {"Type": "work"}}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-316175a2-e86a-4634-9468-6a5c28c94f72 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Request method failure captured: Apr 14 14:24:06 user devstack@n-api.service[61717]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 14:24:06 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:24:06 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:24:06 user devstack@n-api.service[61717]: Connection: close Apr 14 14:24:06 user devstack@n-api.service[61717]: Content-Length: 119 Apr 14 14:24:06 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:24:06 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:24:06 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:24:06 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWIGiqvDoWTVas1HE8AcfKWXdqS81nVaNWbvIILDoVKmGRgeLggqI6v8MsyXcUOCEkImv4oBTrJAab5Pj53iSoGwjhG9HZPP-xbpxYeeDa3C7itZHhr8i1oDBLsEAjPPmC6xnlaewfhZwFE96VMxfRAljfvf97RKR2ZkpwFRKIYa-y0 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Project-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Project-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Tenant: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Tenant-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-User: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:06 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:24:06 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:24:06 user devstack@n-api.service[61717]: X-User-Id: 7b2ae645c9e8423aa718e72294a89af1 Apr 14 14:24:06 user devstack@n-api.service[61717]: X-User-Name: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:06 user devstack@n-api.service[61717]: Apr 14 14:24:06 user devstack@n-api.service[61717]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1479075485", "metadata": {"Type": "work"}}} Apr 14 14:24:06 user devstack@n-api.service[61717]: method: Apr 14 14:24:06 user devstack@n-api.service[61717]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61717]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1479075485', 'metadata': {'Type': 'work'}}}} Apr 14 14:24:06 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise error Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi '' Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 14:24:06 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:24:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-316175a2-e86a-4634-9468-6a5c28c94f72 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-316175a2-e86a-4634-9468-6a5c28c94f72 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012531 Apr 14 14:24:06 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 141/425] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 14:24:06 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:24:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3156993a-8866-4df3-8fe6-49d67b66fe60 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Calling method '.version_select at 0x7f67e43a5630>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-3156993a-8866-4df3-8fe6-49d67b66fe60 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] HTTP exception thrown: Volume tempest-invalid-445903249 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3156993a-8866-4df3-8fe6-49d67b66fe60 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Request method failure captured: Apr 14 14:24:07 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-445903249 HTTP/1.1 Apr 14 14:24:07 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:24:07 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:24:07 user devstack@n-api.service[61718]: Connection: close Apr 14 14:24:07 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:24:07 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:24:07 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:24:07 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:24:07 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWIGiqvDoWTVas1HE8AcfKWXdqS81nVaNWbvIILDoVKmGRgeLggqI6v8MsyXcUOCEkImv4oBTrJAab5Pj53iSoGwjhG9HZPP-xbpxYeeDa3C7itZHhr8i1oDBLsEAjPPmC6xnlaewfhZwFE96VMxfRAljfvf97RKR2ZkpwFRKIYa-y0 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Tenant-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Id: 7b2ae645c9e8423aa718e72294a89af1 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:07 user devstack@n-api.service[61718]: method: Apr 14 14:24:07 user devstack@n-api.service[61718]: exception: Volume tempest-invalid-445903249 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: action_args: {'id': 'tempest-invalid-445903249'} Apr 14 14:24:07 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-445903249 could not be found. (HTTP 404) (Request-ID: req-bb0af379-4ba2-4f32-9d75-fc1cf66b2580) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-445903249 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-445903249 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-445903249 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3156993a-8866-4df3-8fe6-49d67b66fe60 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Returning 404 to user: Volume tempest-invalid-445903249 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-3156993a-8866-4df3-8fe6-49d67b66fe60 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-445903249" status: 404 len: 98 microversion: 2.1 time: 0.041286 Apr 14 14:24:07 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 142/426] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 14:24:06 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-445903249 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 14:24:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-79d8bf81-b27d-4297-82e8-23dbcb0d84c8 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004101 Apr 14 14:24:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 14:24:07 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 14:24:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d39c51b2-ad40-4c80-887a-cf8f9991064a tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003970 Apr 14 14:24:07 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 142/428] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 14:24:07 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 14:24:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2f0ab672-6bf4-402d-85de-d49c8a0e74ef tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Calling method '.version_select at 0x7f67dffbdb40>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-2f0ab672-6bf4-402d-85de-d49c8a0e74ef tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] HTTP exception thrown: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2f0ab672-6bf4-402d-85de-d49c8a0e74ef tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Request method failure captured: Apr 14 14:24:07 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/os-volumes/1a22eb57-1e0e-4232-8a52-77b1018f3013 HTTP/1.1 Apr 14 14:24:07 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:24:07 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:24:07 user devstack@n-api.service[61718]: Connection: close Apr 14 14:24:07 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:24:07 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:24:07 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:24:07 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:24:07 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWIGiqvDoWTVas1HE8AcfKWXdqS81nVaNWbvIILDoVKmGRgeLggqI6v8MsyXcUOCEkImv4oBTrJAab5Pj53iSoGwjhG9HZPP-xbpxYeeDa3C7itZHhr8i1oDBLsEAjPPmC6xnlaewfhZwFE96VMxfRAljfvf97RKR2ZkpwFRKIYa-y0 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Tenant-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Id: 7b2ae645c9e8423aa718e72294a89af1 Apr 14 14:24:07 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:07 user devstack@n-api.service[61718]: method: Apr 14 14:24:07 user devstack@n-api.service[61718]: exception: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: action_args: {'id': '1a22eb57-1e0e-4232-8a52-77b1018f3013'} Apr 14 14:24:07 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. (HTTP 404) (Request-ID: req-2e8dc658-9177-432c-a9e4-c5f8758614d6) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. Apr 14 14:24:07 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2f0ab672-6bf4-402d-85de-d49c8a0e74ef tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Returning 404 to user: Volume 1a22eb57-1e0e-4232-8a52-77b1018f3013 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2f0ab672-6bf4-402d-85de-d49c8a0e74ef tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/1a22eb57-1e0e-4232-8a52-77b1018f3013" status: 404 len: 109 microversion: 2.1 time: 0.042295 Apr 14 14:24:07 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:24:07 2023] DELETE /compute/v2.1/os-volumes/1a22eb57-1e0e-4232-8a52-77b1018f3013 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:24:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c74126e4-9a48-48ca-9718-01c9b5f32072 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Calling method '.version_select at 0x7f67dfd32c20>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-c74126e4-9a48-48ca-9718-01c9b5f32072 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] HTTP exception thrown: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. Apr 14 14:24:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c74126e4-9a48-48ca-9718-01c9b5f32072 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Request method failure captured: Apr 14 14:24:07 user devstack@n-api.service[61716]: request: GET /compute/v2.1/os-volumes/c6997e44-74c6-4d14-ade3-5b45263d79da HTTP/1.1 Apr 14 14:24:07 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:24:07 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:24:07 user devstack@n-api.service[61716]: Connection: close Apr 14 14:24:07 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:24:07 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:24:07 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:24:07 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:24:07 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWIGiqvDoWTVas1HE8AcfKWXdqS81nVaNWbvIILDoVKmGRgeLggqI6v8MsyXcUOCEkImv4oBTrJAab5Pj53iSoGwjhG9HZPP-xbpxYeeDa3C7itZHhr8i1oDBLsEAjPPmC6xnlaewfhZwFE96VMxfRAljfvf97RKR2ZkpwFRKIYa-y0 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Project-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a0c67c29d474a48afdcbc5a4d280b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Tenant-Id: 1a0c67c29d474a48afdcbc5a4d280b02 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesNegativeTest-1478909668 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-User: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:07 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:24:07 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:24:07 user devstack@n-api.service[61716]: X-User-Id: 7b2ae645c9e8423aa718e72294a89af1 Apr 14 14:24:07 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesNegativeTest-1478909668-project-member Apr 14 14:24:07 user devstack@n-api.service[61716]: method: Apr 14 14:24:07 user devstack@n-api.service[61716]: exception: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. Apr 14 14:24:07 user devstack@n-api.service[61716]: action_args: {'id': 'c6997e44-74c6-4d14-ade3-5b45263d79da'} Apr 14 14:24:07 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. (HTTP 404) (Request-ID: req-8b05d3e8-cfb3-4336-bd20-5029f963adb0) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. Apr 14 14:24:07 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c74126e4-9a48-48ca-9718-01c9b5f32072 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] Returning 404 to user: Volume c6997e44-74c6-4d14-ade3-5b45263d79da could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c74126e4-9a48-48ca-9718-01c9b5f32072 tempest-VolumesNegativeTest-1478909668 tempest-VolumesNegativeTest-1478909668-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c6997e44-74c6-4d14-ade3-5b45263d79da" status: 404 len: 109 microversion: 2.1 time: 0.044050 Apr 14 14:24:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 145/430] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:24:07 2023] GET /compute/v2.1/os-volumes/c6997e44-74c6-4d14-ade3-5b45263d79da => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:08 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:09 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-9a78154f-a4f8-48ee-849d-56d9ac7f438c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 200 len: 1544 microversion: 2.1 time: 0.390569 Apr 14 14:24:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 143/431] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:08 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 1544 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=15 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Going to try to stop instance {{(pid=61718) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 14:24:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action" status: 202 len: 0 microversion: 2.1 time: 0.130901 Apr 14 14:24:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 144/432] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:24:10 2023] POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:10 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-023dd632-23ad-4bd3-8bfa-d5f54646f46b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1711 microversion: 2.1 time: 0.292645 Apr 14 14:24:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 146/433] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:10 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1711 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-unplugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Creating event network-vif-unplugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:24:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032001 Apr 14 14:24:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 144/434] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] HTTP exception thrown: Instance bc70d475-20dd-4859-a6fe-d2d09341799e could not be found. Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Request method failure captured: Apr 14 14:24:12 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e HTTP/1.1 Apr 14 14:24:12 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:24:12 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:24:12 user devstack@n-api.service[61718]: Connection: close Apr 14 14:24:12 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:24:12 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:24:12 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:24:12 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:24:12 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBaSSvX4SuWxukIAhT7-tRngr__kzuMHi7Q-1LnVGLb_4GQoykDggrrx10_k0i362O27nNNcCjpiT8MJCve9grCVKK_kCFxRn3Y6PHUvseXWUDr8uay6lOxvqeMrJg3Qk3Jo4ypdSgmHmJHIiayW6JcqePCe0phO-DeJDwg-CSwW-4 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Project-Id: aa21be0383ba4cab992ec2b897e763f4 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesAdminNegativeTest-1341751798 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa21be0383ba4cab992ec2b897e763f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aa21be0383ba4cab992ec2b897e763f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aa21be0383ba4cab992ec2b897e763f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesAdminNegativeTest-1341751798 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Tenant-Id: aa21be0383ba4cab992ec2b897e763f4 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1341751798 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-User: tempest-VolumesAdminNegativeTest-1341751798-project-member Apr 14 14:24:12 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:24:12 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:24:12 user devstack@n-api.service[61718]: X-User-Id: e5c31630bdcb497da65f928490c26948 Apr 14 14:24:12 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesAdminNegativeTest-1341751798-project-member Apr 14 14:24:12 user devstack@n-api.service[61718]: method: > Apr 14 14:24:12 user devstack@n-api.service[61718]: exception: Instance bc70d475-20dd-4859-a6fe-d2d09341799e could not be found. Apr 14 14:24:12 user devstack@n-api.service[61718]: action_args: {'id': 'bc70d475-20dd-4859-a6fe-d2d09341799e'} Apr 14 14:24:12 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc70d475-20dd-4859-a6fe-d2d09341799e could not be found. Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc70d475-20dd-4859-a6fe-d2d09341799e could not be found. Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc70d475-20dd-4859-a6fe-d2d09341799e could not be found. Apr 14 14:24:12 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Returning 404 to user: Instance bc70d475-20dd-4859-a6fe-d2d09341799e could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5fecff76-243a-4de6-8a93-7aea277d2605 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e" status: 404 len: 111 microversion: 2.1 time: 0.033424 Apr 14 14:24:12 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:12 2023] GET /compute/v2.1/servers/bc70d475-20dd-4859-a6fe-d2d09341799e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:24:12 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-73cef6d9-7aa5-47fc-899a-cccab9b9edd9 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Calling method '.version_select at 0x7f67dfd33760>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-73cef6d9-7aa5-47fc-899a-cccab9b9edd9 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706581506" status: 202 len: 0 microversion: 2.1 time: 0.025252 Apr 14 14:24:12 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 14:24:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706581506 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:24:12 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:24:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Apr 14 14:24:12 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 145/437] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:28 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-61ab0c3a-b904-4585-8e70-fd66b27d24ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1503 microversion: 2.1 time: 0.279171 Apr 14 14:24:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:28 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:30 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=5 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:30 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:30 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7bb24545-b9ec-4200-8ba4-20565de2a472 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '.version_select at 0x7f67dfd33910>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7bb24545-b9ec-4200-8ba4-20565de2a472 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f" status: 200 len: 1723 microversion: 2.1 time: 0.055140 Apr 14 14:24:30 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 148/439] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 14:24:30 2023] GET /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f => generated 1723 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=9 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8cea64ca-6e70-417a-ad11-01d58194959f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '.version_select at 0x7f67dfed4160>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8cea64ca-6e70-417a-ad11-01d58194959f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f" status: 200 len: 1723 microversion: 2.1 time: 0.057248 Apr 14 14:24:30 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 146/440] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 14:24:30 2023] GET /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f => generated 1723 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:30 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-6854a840-5e82-4c8e-86b0-bcfda8aff351 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1671 microversion: 2.1 time: 0.252817 Apr 14 14:24:30 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:30 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1671 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1102932524", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "9edb5ed2-1710-4203-821d-23e54cf33690"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:39 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] validate_networks() for [('9edb5ed2-1710-4203-821d-23e54cf33690', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Getting quotas for project cd6ef742f6534538a9452fe0d4ddce56. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Getting quotas for user 2de5e6883ff54d049fba7810fe4f1f38 and project cd6ef742f6534538a9452fe0d4ddce56. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:24:40 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:24:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.591415 Apr 14 14:24:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 149/442] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:24:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:24:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a9f43127-2ae5-4137-be83-9121826bd681 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:40 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a9f43127-2ae5-4137-be83-9121826bd681 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:40 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a9f43127-2ae5-4137-be83-9121826bd681 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a9f43127-2ae5-4137-be83-9121826bd681 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" status: 200 len: 1208 microversion: 2.1 time: 0.070177 Apr 14 14:24:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 147/443] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:40 2023] GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => generated 1208 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0", "tag": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:43 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:43 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=12 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Creating event network-changed:0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 on user Apr 14 14:24:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038312 Apr 14 14:24:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 148/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HTTP exception thrown: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Request method failure captured: Apr 14 14:24:43 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 HTTP/1.1 Apr 14 14:24:43 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:24:43 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:24:43 user devstack@n-api.service[61716]: Connection: close Apr 14 14:24:43 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:24:43 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:24:43 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:24:43 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:24:43 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBnVL98smIPP0Ij9Hk63fFPCem8SvJZvGAl8-ai3ZHw9HfwXbGatsKnuTXSfm3Yifi2mKB-8KYwgG4bxNBpkprUivuGpYBzzS52MqA7TusPpQp9h7jzhBeGZ_npujtAKjrOVe-OwWXAOA6m2CF6Tq4v1xiuk77bT3r4CoXkJnEETi0 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Project-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Tenant-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:24:43 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:24:43 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:24:43 user devstack@n-api.service[61716]: X-User-Id: a7a99d9a44334bfeb39f6684853f6844 Apr 14 14:24:43 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:24:43 user devstack@n-api.service[61716]: method: > Apr 14 14:24:43 user devstack@n-api.service[61716]: exception: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:24:43 user devstack@n-api.service[61716]: action_args: {'id': 'e81e92d6-b79e-46db-b69e-1f7584440287'} Apr 14 14:24:43 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:24:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:24:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Returning 404 to user: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-87583818-6989-46ad-b20f-10c9541fbf98 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 404 len: 111 microversion: 2.20 time: 0.028556 Apr 14 14:24:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 150/445] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:24:43 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:24:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6167e806-72fa-4e4a-95a7-44999ee5a488 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '.version_select at 0x7f67dfe44b80>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6167e806-72fa-4e4a-95a7-44999ee5a488 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394852903" status: 204 len: 0 microversion: 2.20 time: 0.022702 Apr 14 14:24:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 148/446] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 14:24:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394852903 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:24:44 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2391a367-2b36-40fc-921f-d5527b2aa910 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'create', calling method: .version_select at 0x7f67dffbfd00>, body: {"keypair": {"name": "tempest-keypair-428673856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC39skeqyy/RTc2E6soubP86qzQn/9pjIW/1tJXv0fmp+gdA0Bxhni7OkdPTKsoLqOCieZ5vJZzWbW7TfycVdcSU7X4yS6qH4uWHDqSZ80Xuf9itLdPoLws4FAivnu+l1A=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:44 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-2391a367-2b36-40fc-921f-d5527b2aa910 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for project b8263321b4e34ea08350e97ac2a3a794. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:24:44 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-2391a367-2b36-40fc-921f-d5527b2aa910 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for user a7a99d9a44334bfeb39f6684853f6844 and project b8263321b4e34ea08350e97ac2a3a794. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:24:44 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2391a367-2b36-40fc-921f-d5527b2aa910 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046117 Apr 14 14:24:44 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 149/447] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 14:24:44 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 14:24:45 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0", "name": "network-vif-plugged", "status": "completed", "tag": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Creating event network-vif-plugged:0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 on user Apr 14 14:24:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032567 Apr 14 14:24:45 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 151/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1136227517", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e0719d7f-e55b-4c63-91f9-8feef7bd3905"}], "security_groups": [{"name": "tempest-securitygroup--1060318057"}], "key_name": "tempest-keypair-428673856", "user_data": "}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:46 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] validate_networks() for [('e0719d7f-e55b-4c63-91f9-8feef7bd3905', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for project b8263321b4e34ea08350e97ac2a3a794. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting quotas for user a7a99d9a44334bfeb39f6684853f6844 and project b8263321b4e34ea08350e97ac2a3a794. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-dc06714f-94e0-4d0c-b021-b355938c9a53 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-259075801", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "79416463-b265-4588-8d03-bcb84f0ecc83", "destination_type": "local"}, {"source_type": "volume", "uuid": "569d4e88-5bb5-4f08-8e57-9bb306afb76d", "destination_type": "invalid"}], "networks": [{"uuid": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-dc06714f-94e0-4d0c-b021-b355938c9a53 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Request method failure captured: Apr 14 14:24:47 user devstack@n-api.service[61718]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 14:24:47 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:24:47 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:24:47 user devstack@n-api.service[61718]: Connection: close Apr 14 14:24:47 user devstack@n-api.service[61718]: Content-Length: 493 Apr 14 14:24:47 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:24:47 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:24:47 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:24:47 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBghrnWKhC_DlZCkE1y1ACbAE1XEqwKBxd4tP62sUc0RVPfTMTeffBrLtrlZSL1JOYJCEW_zuobTFgUbAKt3EUXW-d6WTZHLOZiXEvDMvhW1Hsh2_YcwjNd6IDWwZseeB5bXSONjLCPhtR8OGnwbCe2WQWJOweFhsZyWj8-LBZP20k Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Project-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08dbbd3691924823b98d44b11508019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Tenant: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Tenant-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:24:47 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:24:47 user devstack@n-api.service[61718]: X-User: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:24:47 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:24:47 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:24:47 user devstack@n-api.service[61718]: X-User-Id: a609ae82102a4ec994823e59f1a37378 Apr 14 14:24:47 user devstack@n-api.service[61718]: X-User-Name: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:24:47 user devstack@n-api.service[61718]: Apr 14 14:24:47 user devstack@n-api.service[61718]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-259075801", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "79416463-b265-4588-8d03-bcb84f0ecc83", "destination_type": "local"}, {"source_type": "volume", "uuid": "569d4e88-5bb5-4f08-8e57-9bb306afb76d", "destination_type": "invalid"}], "networks": [{"uuid": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2"}]}} Apr 14 14:24:47 user devstack@n-api.service[61718]: method: > Apr 14 14:24:47 user devstack@n-api.service[61718]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 14:24:47 user devstack@n-api.service[61718]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-259075801', 'imageRef': '79416463-b265-4588-8d03-bcb84f0ecc83', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '79416463-b265-4588-8d03-bcb84f0ecc83', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '569d4e88-5bb5-4f08-8e57-9bb306afb76d', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6dbfb18b-1c4c-42fe-8597-3b57e05446a2'}]}}} Apr 14 14:24:47 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise error Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 14:24:47 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-dc06714f-94e0-4d0c-b021-b355938c9a53 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:24:47 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.094600 Apr 14 14:24:47 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 149/449] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:24:46 2023] POST /compute/v2.1/servers => generated 400 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:24:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-dc06714f-94e0-4d0c-b021-b355938c9a53 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010965 Apr 14 14:24:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 150/450] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:24:47 2023] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2a8f02f1-bb8b-4098-9995-02e607a407b1 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2a8f02f1-bb8b-4098-9995-02e607a407b1 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-2a8f02f1-bb8b-4098-9995-02e607a407b1 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-2a8f02f1-bb8b-4098-9995-02e607a407b1 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:47 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-2a8f02f1-bb8b-4098-9995-02e607a407b1 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:47 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2a8f02f1-bb8b-4098-9995-02e607a407b1 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1275 microversion: 2.20 time: 0.064071 Apr 14 14:24:47 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 150/451] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:24:47 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1275 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:24:47 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2d00fd96-f829-4a76-9383-986ea41a6921 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1494 microversion: 2.1 time: 0.256880 Apr 14 14:24:47 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:47 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1494 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0", "name": "network-vif-plugged", "status": "completed", "tag": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Creating event network-vif-plugged:0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 on user Apr 14 14:24:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039250 Apr 14 14:24:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 151/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Creating event network-changed:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:24:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031815 Apr 14 14:24:49 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 151/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-96713f08-a9eb-4de1-a1e7-4034dfc288aa tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049234 Apr 14 14:24:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 153/455] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:24:50 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1636fe26-9c10-4eb0-b80b-313110c00128 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1677 microversion: 2.1 time: 0.290193 Apr 14 14:24:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 152/456] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:51 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1677 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-694ae004-75c5-465e-ae10-9bbf82a0b231 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1677 microversion: 2.1 time: 0.249194 Apr 14 14:24:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:51 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:51 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:24:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-0884160a-a470-479c-8755-0605fab33923 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1677 microversion: 2.1 time: 0.268642 Apr 14 14:24:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 154/458] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:24:51 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:24:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-plugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Creating event network-vif-plugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:24:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029993 Apr 14 14:24:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 153/459] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-plugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Creating event network-vif-plugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:24:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028932 Apr 14 14:24:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-983098674"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:58 user devstack@n-api.service[61716]: INFO nova.network.security_group_api [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Removing security group e73f55a4-3a41-44bd-82ce-228ba9be6888 from port cc694601-d879-4214-ac40-2242faaec5bf Apr 14 14:24:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a44c9871-ae9f-4e45-8887-d92e9fd95734 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/action" status: 202 len: 0 microversion: 2.1 time: 0.737362 Apr 14 14:24:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 155/461] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:24:58 2023] POST /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:24:58 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:24:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Creating event network-changed:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:24:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039612 Apr 14 14:24:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 154/462] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:24:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:59 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'services' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:24:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments/0591f14c-b6cc-477c-833e-ddb91e7bd431" status: 202 len: 0 microversion: 2.1 time: 0.177151 Apr 14 14:24:59 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:24:59 2023] DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments/0591f14c-b6cc-477c-833e-ddb91e7bd431 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:24:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:24:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-803dabd2-ccf5-4f59-bfac-3bf4eb46b7ca tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Apr 14 14:24:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 156/464] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:24:59 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:00 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f797197d-5357-44c2-8076-fa39764fdaa8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1688 microversion: 2.1 time: 0.228917 Apr 14 14:25:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 155/465] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:00 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:00 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Creating event network-changed:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:25:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Apr 14 14:25:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 155/466] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:09 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=35 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:09 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7c99b6e3-a4b7-4c9e-9e95-836d0571db8f tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.198691 Apr 14 14:25:09 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 157/467] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:25:09 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/os-interface => generated 282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Creating event network-changed:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027981 Apr 14 14:25:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 156/468] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f4a9a072-9146-4784-9835-1e783613de27 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/ips" status: 200 len: 107 microversion: 2.1 time: 0.038702 Apr 14 14:25:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:25:10 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/ips => generated 107 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8f8a6ce-1a76-4c0b-909c-96ff91ba5696"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Invalid volume: volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 is already attached to instances: fafce4d3-18c4-4f15-af62-e599c7749efe Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:25:10 user devstack@n-api.service[61716]: request: POST /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/os-volume_attachments HTTP/1.1 Apr 14 14:25:10 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:25:10 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:25:10 user devstack@n-api.service[61716]: Connection: close Apr 14 14:25:10 user devstack@n-api.service[61716]: Content-Length: 74 Apr 14 14:25:10 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:25:10 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:25:10 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:25:10 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:25:10 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:25:10 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:25:10 user devstack@n-api.service[61716]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:25:10 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:25:10 user devstack@n-api.service[61716]: Apr 14 14:25:10 user devstack@n-api.service[61716]: {"volumeAttachment": {"volumeId": "f8f8a6ce-1a76-4c0b-909c-96ff91ba5696"}} Apr 14 14:25:10 user devstack@n-api.service[61716]: method: > Apr 14 14:25:10 user devstack@n-api.service[61716]: exception: Invalid volume: volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 is already attached to instances: fafce4d3-18c4-4f15-af62-e599c7749efe Apr 14 14:25:10 user devstack@n-api.service[61716]: action_args: {'server_id': 'd9de3e2a-3325-4bc9-bfb3-9388a620abaf', 'body': {'volumeAttachment': {'volumeId': 'f8f8a6ce-1a76-4c0b-909c-96ff91ba5696'}}} Apr 14 14:25:10 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 is already attached to instances: fafce4d3-18c4-4f15-af62-e599c7749efe Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 is already attached to instances: fafce4d3-18c4-4f15-af62-e599c7749efe Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 is already attached to instances: fafce4d3-18c4-4f15-af62-e599c7749efe Apr 14 14:25:10 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 400 to user: Invalid volume: volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 is already attached to instances: fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:25:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f5fd5ef0-1916-4f19-9228-89d57f7a8ca8 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140081 Apr 14 14:25:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 158/470] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:25:10 2023] POST /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:25:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 204 len: 0 microversion: 2.1 time: 0.156567 Apr 14 14:25:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 157/471] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:25:10 2023] DELETE /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:11 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6e71a7f5-360e-47fe-b8ab-294d05333053 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 200 len: 1550 microversion: 2.1 time: 0.268911 Apr 14 14:25:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 157/472] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:10 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 1550 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:11 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-unplugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Creating event network-vif-unplugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029613 Apr 14 14:25:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 159/473] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-plugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}, {"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-plugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}, {"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-plugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}, {"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-unplugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}, {"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-plugged", "status": "completed", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}, {"server_uuid": "d9de3e2a-3325-4bc9-bfb3-9388a620abaf", "name": "network-vif-deleted", "tag": "50c5a068-52cf-43f3-8065-6ada257d3449"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Creating event network-vif-plugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Creating event network-vif-plugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Creating event network-vif-plugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Creating event network-vif-unplugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Creating event network-vif-plugged:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Creating event network-vif-deleted:50c5a068-52cf-43f3-8065-6ada257d3449 for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf on user Apr 14 14:25:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.037543 Apr 14 14:25:13 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 158/474] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:30 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:30 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=5 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:30 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=11 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7ad92215-5e39-45e4-abea-e2f62b455eed tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" status: 200 len: 1486 microversion: 2.1 time: 0.233598 Apr 14 14:25:30 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 158/475] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:30 2023] GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:30 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-dcbcd401-b00e-47a8-b73b-4514e55158d0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'create', calling method: .version_select at 0x7f67dfd33400>, body: {"keypair": {"name": "tempest-keypair-1178292711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPuRsvBsGHusqtnaC8Oj9LBXgh3nY9LkQ3OL84XGLcTKFxNlys1/HBw5E8x0pZTchYk3yzjHgyDVXSLOySeUV4vk6BzjfyRxiyugq/K16fvubSEZS4xq2p9ZGyf7T/74w=="}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:30 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-dcbcd401-b00e-47a8-b73b-4514e55158d0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for project b53efd997e3e47d898264dae8a27a5ad. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:25:30 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-dcbcd401-b00e-47a8-b73b-4514e55158d0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for user cdfcb787b0f545f8b19e947d54d07b9c and project b53efd997e3e47d898264dae8a27a5ad. Resources: {'key_pairs'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:25:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-dcbcd401-b00e-47a8-b73b-4514e55158d0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056320 Apr 14 14:25:30 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 160/476] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:25:30 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:31 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f7311ae1-e565-48e4-91f6-a007db852792 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1671 microversion: 2.1 time: 0.424903 Apr 14 14:25:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:31 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1671 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2056227109", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80"}], "security_groups": [{"name": "tempest-securitygroup--930779902"}], "key_name": "tempest-keypair-1178292711", "user_data": "}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] validate_networks() for [('ad43cdc7-07dc-4fda-bc56-3290a2d03c80', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for project b53efd997e3e47d898264dae8a27a5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting quotas for user cdfcb787b0f545f8b19e947d54d07b9c and project b53efd997e3e47d898264dae8a27a5ad. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:25:33 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:25:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650221 Apr 14 14:25:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 159/478] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:25:33 2023] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:25:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-9ccb18e9-50fb-4d33-b4ee-9d27c19f0fdb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:34 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-9ccb18e9-50fb-4d33-b4ee-9d27c19f0fdb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:34 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-9ccb18e9-50fb-4d33-b4ee-9d27c19f0fdb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-9ccb18e9-50fb-4d33-b4ee-9d27c19f0fdb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1240 microversion: 2.1 time: 0.075262 Apr 14 14:25:34 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 161/479] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:34 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee4fd548-c01c-41ed-a231-433d83cb29da"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:34 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452808 Apr 14 14:25:34 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 160/480] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:25:34 2023] POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:37 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7d9e2fbe-ceb3-42ee-85dc-a5d77389ea0f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1586 microversion: 2.20 time: 0.238460 Apr 14 14:25:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 160/481] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:25:37 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1586 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:25:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Creating event network-changed:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:25:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029922 Apr 14 14:25:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 162/482] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:25:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031845 Apr 14 14:25:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 161/483] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:25:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047724 Apr 14 14:25:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 161/484] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "32a818ca-b377-4b5e-8903-b6cf62547d0f"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:42 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'flavor' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:25:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/action" status: 200 len: 29 microversion: 2.1 time: 0.205841 Apr 14 14:25:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 163/485] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:25:42 2023] POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/action => generated 29 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-88e9d3b9-5efe-4dba-8b11-978ef1e91b31 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1723 microversion: 2.1 time: 0.279719 Apr 14 14:25:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 162/486] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:42 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Creating event network-vif-unplugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:25:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031517 Apr 14 14:25:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 162/487] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:45 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:45 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:25:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037537 Apr 14 14:25:45 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 164/488] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:25:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062752 Apr 14 14:25:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 163/489] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:49 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:49 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:25:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:25:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044780 Apr 14 14:25:49 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 163/490] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2c348979-a9db-4b24-a539-544297caec71 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.275162 Apr 14 14:25:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 165/491] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:25:50 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments => generated 25 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HTTP exception thrown: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf is not attached to volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Request method failure captured: Apr 14 14:25:50 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments/0591f14c-b6cc-477c-833e-ddb91e7bd431 HTTP/1.1 Apr 14 14:25:50 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:25:50 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:25:50 user devstack@n-api.service[61718]: Connection: close Apr 14 14:25:50 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:25:50 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:25:50 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:25:50 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:25:50 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWE3luzi1Kmg8L-WniG6lCLe55O0X22ilshlP8DOegDb8kckADGnd3lD7qU-8TnTEQSjaDxU8dWbcsgzkNlPLzPc3Hmdcs7AYvYyWvLMdc3_fNgLFKHdW-P14me35-UUQJXkOfcQd7HJEIkUEBA2nXbFD3XGsq1fCG2YP0ZXmnhkyS4 Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Project-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Project-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1df398dd4f844286b41ee4948001013a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Tenant: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Tenant-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:25:50 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:25:50 user devstack@n-api.service[61718]: X-User: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:25:50 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:25:50 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:25:50 user devstack@n-api.service[61718]: X-User-Id: 19dad04c158549c39991ea05fca2531d Apr 14 14:25:50 user devstack@n-api.service[61718]: X-User-Name: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:25:50 user devstack@n-api.service[61718]: method: > Apr 14 14:25:50 user devstack@n-api.service[61718]: exception: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf is not attached to volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 Apr 14 14:25:50 user devstack@n-api.service[61718]: action_args: {'server_id': '201765ec-21d3-4a0e-89f0-ece907f350bf', 'id': '0591f14c-b6cc-477c-833e-ddb91e7bd431'} Apr 14 14:25:50 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0591f14c-b6cc-477c-833e-ddb91e7bd431. Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf is not attached to volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf is not attached to volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 Apr 14 14:25:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:25:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Returning 404 to user: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf is not attached to volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:25:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1fee2708-3845-4af3-aaa9-4441c4acdaa0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments/0591f14c-b6cc-477c-833e-ddb91e7bd431" status: 404 len: 154 microversion: 2.1 time: 0.097133 Apr 14 14:25:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 164/492] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:25:50 2023] DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf/os-volume_attachments/0591f14c-b6cc-477c-833e-ddb91e7bd431 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] HTTP exception thrown: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Request method failure captured: Apr 14 14:25:54 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 HTTP/1.1 Apr 14 14:25:54 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:25:54 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:25:54 user devstack@n-api.service[61717]: Connection: close Apr 14 14:25:54 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:25:54 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:25:54 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:25:54 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:25:54 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBghrnWKhC_DlZCkE1y1ACbAE1XEqwKBxd4tP62sUc0RVPfTMTeffBrLtrlZSL1JOYJCEW_zuobTFgUbAKt3EUXW-d6WTZHLOZiXEvDMvhW1Hsh2_YcwjNd6IDWwZseeB5bXSONjLCPhtR8OGnwbCe2WQWJOweFhsZyWj8-LBZP20k Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Project-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08dbbd3691924823b98d44b11508019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Tenant: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Tenant-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:25:54 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:25:54 user devstack@n-api.service[61717]: X-User: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:25:54 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:25:54 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:25:54 user devstack@n-api.service[61717]: X-User-Id: a609ae82102a4ec994823e59f1a37378 Apr 14 14:25:54 user devstack@n-api.service[61717]: X-User-Name: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:25:54 user devstack@n-api.service[61717]: method: > Apr 14 14:25:54 user devstack@n-api.service[61717]: exception: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61717]: action_args: {'id': 'f40364b4-9668-45e3-8d72-d6e49ebb0147'} Apr 14 14:25:54 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Returning 404 to user: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:25:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a774807c-6117-4f13-9b85-6483032e54ad tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 404 len: 111 microversion: 2.1 time: 0.039601 Apr 14 14:25:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 164/493] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:25:54 2023] DELETE /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] HTTP exception thrown: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Request method failure captured: Apr 14 14:25:54 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 HTTP/1.1 Apr 14 14:25:54 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:25:54 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:25:54 user devstack@n-api.service[61716]: Connection: close Apr 14 14:25:54 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:25:54 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:25:54 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:25:54 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:25:54 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBghrnWKhC_DlZCkE1y1ACbAE1XEqwKBxd4tP62sUc0RVPfTMTeffBrLtrlZSL1JOYJCEW_zuobTFgUbAKt3EUXW-d6WTZHLOZiXEvDMvhW1Hsh2_YcwjNd6IDWwZseeB5bXSONjLCPhtR8OGnwbCe2WQWJOweFhsZyWj8-LBZP20k Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Project-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08dbbd3691924823b98d44b11508019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Tenant: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Tenant-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:25:54 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:25:54 user devstack@n-api.service[61716]: X-User: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:25:54 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:25:54 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:25:54 user devstack@n-api.service[61716]: X-User-Id: a609ae82102a4ec994823e59f1a37378 Apr 14 14:25:54 user devstack@n-api.service[61716]: X-User-Name: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:25:54 user devstack@n-api.service[61716]: method: > Apr 14 14:25:54 user devstack@n-api.service[61716]: exception: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61716]: action_args: {'id': 'f40364b4-9668-45e3-8d72-d6e49ebb0147'} Apr 14 14:25:54 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. Apr 14 14:25:54 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Returning 404 to user: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:25:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7471c8ed-9a12-4b8c-9cdc-8a00a51533c5 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147" status: 404 len: 111 microversion: 2.1 time: 0.033062 Apr 14 14:25:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 166/494] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:54 2023] GET /compute/v2.1/servers/f40364b4-9668-45e3-8d72-d6e49ebb0147 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:25:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 204 len: 0 microversion: 2.1 time: 0.127272 Apr 14 14:25:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 165/495] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:25:54 2023] DELETE /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8", "name": "network-vif-unplugged", "status": "completed", "tag": "af22d0f9-f6de-4604-90f0-833f831a7a37"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-643fa345-1df1-4691-bd61-6ed8962d0234 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 200 len: 1500 microversion: 2.1 time: 0.329252 Apr 14 14:25:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 165/496] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:54 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 1500 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Creating event network-vif-unplugged:af22d0f9-f6de-4604-90f0-833f831a7a37 for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 on user Apr 14 14:25:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028682 Apr 14 14:25:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 166/497] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d1fcf666-0ccb-48e2-b00a-d16c2caf4c28 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1677 microversion: 2.1 time: 0.347718 Apr 14 14:25:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 167/498] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:54 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1677 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388858 Apr 14 14:25:55 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 166/499] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:25:54 2023] POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8", "name": "network-vif-plugged", "status": "completed", "tag": "af22d0f9-f6de-4604-90f0-833f831a7a37"}, {"server_uuid": "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8", "name": "network-vif-deleted", "tag": "af22d0f9-f6de-4604-90f0-833f831a7a37"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Creating event network-vif-plugged:af22d0f9-f6de-4604-90f0-833f831a7a37 for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 on user Apr 14 14:25:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Creating event network-vif-deleted:af22d0f9-f6de-4604-90f0-833f831a7a37 for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 on user Apr 14 14:25:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035225 Apr 14 14:25:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 167/500] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:25:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 204 len: 0 microversion: 2.1 time: 0.125765 Apr 14 14:25:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 168/501] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:25:58 2023] DELETE /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:58 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:25:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-249420a1-2112-4872-8c81-4894309285e7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 200 len: 1542 microversion: 2.1 time: 0.303169 Apr 14 14:25:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 167/502] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:25:58 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 1542 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:25:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-unplugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}, {"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-plugged", "status": "completed", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:25:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:25:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:25:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:25:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Creating event network-vif-unplugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:25:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Creating event network-vif-plugged:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:25:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030403 Apr 14 14:25:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 168/503] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:25:58 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Going to try to start instance {{(pid=61716) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 14:26:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action" status: 202 len: 0 microversion: 2.1 time: 0.100552 Apr 14 14:26:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 169/504] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:26:00 2023] POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201765ec-21d3-4a0e-89f0-ece907f350bf", "name": "network-vif-deleted", "tag": "cc694601-d879-4214-ac40-2242faaec5bf"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] Creating event network-vif-deleted:cc694601-d879-4214-ac40-2242faaec5bf for instance 201765ec-21d3-4a0e-89f0-ece907f350bf on user Apr 14 14:26:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031039 Apr 14 14:26:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 169/505] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:00 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:26:01 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf HTTP/1.1 Apr 14 14:26:01 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:26:01 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:26:01 user devstack@n-api.service[61716]: Connection: close Apr 14 14:26:01 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:26:01 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:26:01 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:26:01 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:26:01 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:26:01 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:26:01 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:26:01 user devstack@n-api.service[61716]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:26:01 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:26:01 user devstack@n-api.service[61716]: method: > Apr 14 14:26:01 user devstack@n-api.service[61716]: exception: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:26:01 user devstack@n-api.service[61716]: action_args: {'id': 'd9de3e2a-3325-4bc9-bfb3-9388a620abaf'} Apr 14 14:26:01 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:26:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:26:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a281d9cf-949c-41a1-ae61-ef3b8a471547 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 404 len: 111 microversion: 2.1 time: 0.034431 Apr 14 14:26:01 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 170/506] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:01 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:26:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-441189b4-8432-4188-a5ba-8c5219eff190 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '.version_select at 0x7f67dfe6b0a0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-441189b4-8432-4188-a5ba-8c5219eff190 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630351444" status: 202 len: 0 microversion: 2.1 time: 0.023772 Apr 14 14:26:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 170/507] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 14:26:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630351444 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:26:01 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-dab7d0a7-1ba7-4a00-8e1d-ddf35bc80c1e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1697 microversion: 2.1 time: 0.377932 Apr 14 14:26:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 168/508] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:00 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1697 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:02 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'services' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:26:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments/f8f8a6ce-1a76-4c0b-909c-96ff91ba5696" status: 202 len: 0 microversion: 2.1 time: 0.207416 Apr 14 14:26:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 171/509] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:26:02 2023] DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments/f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:02 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:02 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-80d0bd38-9915-4ee9-8a8b-8ccad6bef39a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064476 Apr 14 14:26:02 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 171/510] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:26:02 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Old instance type m1.nano, new instance type m1.micro {{(pid=61717) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:26:03 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:26:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/action" status: 202 len: 0 microversion: 2.1 time: 0.358915 Apr 14 14:26:03 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 169/511] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:26:02 2023] POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:03 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f20b1864-9c26-4302-9c02-1b52cbd3297e tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1732 microversion: 2.1 time: 0.316857 Apr 14 14:26:03 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 172/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:03 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1732 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Creating event network-vif-unplugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:26:06 user devstack@n-api.service[61718]: DEBUG nova.compute.api [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61718) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:26:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043355 Apr 14 14:26:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 172/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:06 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:26:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048718 Apr 14 14:26:06 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 170/514] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:08 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:26:08 user devstack@n-api.service[61716]: DEBUG nova.compute.api [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:26:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044647 Apr 14 14:26:08 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 173/515] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:08 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:26:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028999 Apr 14 14:26:08 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 173/516] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=17 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:18 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:26:18 user devstack@n-api.service[61717]: DEBUG nova.compute.api [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:26:18 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062296 Apr 14 14:26:18 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 171/517] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=7 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:20 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:26:20 user devstack@n-api.service[61716]: DEBUG nova.compute.api [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:26:20 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037517 Apr 14 14:26:20 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 174/518] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=5 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=11 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:24 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0ea5045b-752e-4232-8445-5b05245ed6d3 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1552 microversion: 2.1 time: 0.229847 Apr 14 14:26:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 174/519] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:24 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1552 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:31 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:26:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" status: 204 len: 0 microversion: 2.1 time: 0.126486 Apr 14 14:26:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 172/520] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:26:31 2023] DELETE /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0", "name": "network-vif-unplugged", "status": "completed", "tag": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:31 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Creating event network-vif-unplugged:0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 on user Apr 14 14:26:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6d7e93c7-7bc3-4e07-a7fc-b1fb4628f0f8 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" status: 200 len: 1492 microversion: 2.1 time: 0.247191 Apr 14 14:26:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 175/521] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:31 2023] GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => generated 1492 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038860 Apr 14 14:26:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 175/522] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:32 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0", "name": "network-vif-deleted", "tag": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] Creating event network-vif-deleted:0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 on user Apr 14 14:26:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028182 Apr 14 14:26:32 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 173/523] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:32 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:33 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:33 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7ff1213f-b201-488a-b89a-786fc26f4402 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1703 microversion: 2.1 time: 0.207447 Apr 14 14:26:33 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 176/524] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:32 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1703 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0", "name": "network-vif-plugged", "status": "completed", "tag": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Creating event network-vif-plugged:0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 on user Apr 14 14:26:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028311 Apr 14 14:26:33 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 176/525] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-00cc2ae1-62f4-4ec1-8af3-c22fe2cd0772 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.182637 Apr 14 14:26:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 174/526] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 14:26:37 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-interface => generated 282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:26:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Creating event network-changed:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:26:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030129 Apr 14 14:26:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 177/527] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5c28e4f0-618c-4dbf-9daf-ce7e62e93272 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/ips" status: 200 len: 109 microversion: 2.20 time: 0.036757 Apr 14 14:26:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 177/528] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 14:26:38 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:41 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'flavor' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:26:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/action" status: 202 len: 0 microversion: 2.20 time: 0.834036 Apr 14 14:26:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 175/529] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:26:41 2023] POST /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/action => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:42 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:42 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:42 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e08c281e-3a42-4a7a-885e-24c8c9429842 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1710 microversion: 2.20 time: 0.323370 Apr 14 14:26:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 178/530] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:26:41 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1710 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:26:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-unplugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Creating event network-vif-unplugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:26:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050891 Apr 14 14:26:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 178/531] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-plugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Creating event network-vif-plugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:26:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029922 Apr 14 14:26:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 176/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] HTTP exception thrown: Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 could not be found. Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Request method failure captured: Apr 14 14:26:44 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 HTTP/1.1 Apr 14 14:26:44 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:26:44 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:26:44 user devstack@n-api.service[61716]: Connection: close Apr 14 14:26:44 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:26:44 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:26:44 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:26:44 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:26:44 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBghrnWKhC_DlZCkE1y1ACbAE1XEqwKBxd4tP62sUc0RVPfTMTeffBrLtrlZSL1JOYJCEW_zuobTFgUbAKt3EUXW-d6WTZHLOZiXEvDMvhW1Hsh2_YcwjNd6IDWwZseeB5bXSONjLCPhtR8OGnwbCe2WQWJOweFhsZyWj8-LBZP20k Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Project-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08dbbd3691924823b98d44b11508019e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08dbbd3691924823b98d44b11508019e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Tenant: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Tenant-Id: 08dbbd3691924823b98d44b11508019e Apr 14 14:26:44 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1373448962 Apr 14 14:26:44 user devstack@n-api.service[61716]: X-User: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:26:44 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:26:44 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:26:44 user devstack@n-api.service[61716]: X-User-Id: a609ae82102a4ec994823e59f1a37378 Apr 14 14:26:44 user devstack@n-api.service[61716]: X-User-Name: tempest-ServersNegativeTestJSON-1373448962-project-member Apr 14 14:26:44 user devstack@n-api.service[61716]: method: > Apr 14 14:26:44 user devstack@n-api.service[61716]: exception: Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 could not be found. Apr 14 14:26:44 user devstack@n-api.service[61716]: action_args: {'id': '0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8'} Apr 14 14:26:44 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 could not be found. Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 could not be found. Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 could not be found. Apr 14 14:26:44 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:26:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Returning 404 to user: Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:26:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-838bd7ac-7ab1-4082-a0d9-a7d804862021 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" status: 404 len: 111 microversion: 2.1 time: 0.026668 Apr 14 14:26:44 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 179/533] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:44 2023] GET /compute/v2.1/servers/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:26:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Creating event network-changed:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:26:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036749 Apr 14 14:26:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 179/534] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HTTP exception thrown: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf could not be found. Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Request method failure captured: Apr 14 14:26:48 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf HTTP/1.1 Apr 14 14:26:48 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:26:48 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:26:48 user devstack@n-api.service[61717]: Connection: close Apr 14 14:26:48 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:26:48 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:26:48 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:26:48 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:26:48 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWE3luzi1Kmg8L-WniG6lCLe55O0X22ilshlP8DOegDb8kckADGnd3lD7qU-8TnTEQSjaDxU8dWbcsgzkNlPLzPc3Hmdcs7AYvYyWvLMdc3_fNgLFKHdW-P14me35-UUQJXkOfcQd7HJEIkUEBA2nXbFD3XGsq1fCG2YP0ZXmnhkyS4 Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Project-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1df398dd4f844286b41ee4948001013a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Tenant: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Tenant-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:26:48 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:26:48 user devstack@n-api.service[61717]: X-User: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:26:48 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:26:48 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:26:48 user devstack@n-api.service[61717]: X-User-Id: 19dad04c158549c39991ea05fca2531d Apr 14 14:26:48 user devstack@n-api.service[61717]: X-User-Name: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:26:48 user devstack@n-api.service[61717]: method: > Apr 14 14:26:48 user devstack@n-api.service[61717]: exception: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf could not be found. Apr 14 14:26:48 user devstack@n-api.service[61717]: action_args: {'id': '201765ec-21d3-4a0e-89f0-ece907f350bf'} Apr 14 14:26:48 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf could not be found. Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf could not be found. Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf could not be found. Apr 14 14:26:48 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:26:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Returning 404 to user: Instance 201765ec-21d3-4a0e-89f0-ece907f350bf could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:26:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1716634f-4f73-4743-8b99-47e875e45184 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf" status: 404 len: 111 microversion: 2.1 time: 0.032988 Apr 14 14:26:48 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 177/535] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:48 2023] GET /compute/v2.1/servers/201765ec-21d3-4a0e-89f0-ece907f350bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:26:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-289c7a71-cd7b-4a91-94de-861f704a72e9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '.version_select at 0x7f67dfc62dd0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-289c7a71-cd7b-4a91-94de-861f704a72e9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2096424138" status: 202 len: 0 microversion: 2.1 time: 0.023996 Apr 14 14:26:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 180/536] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 14:26:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2096424138 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 14:26:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9099a325-3e5e-4b16-bf20-0d61c7138a8f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'create', calling method: .version_select at 0x7f67dfe6aef0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-349171501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLPNmyz5FZJ3JAXf567ogWCKZDDVaqr9sdsziyTaoW8c91s8+u4CUBY6blg8NMdt+y5NCYJ1EOsl2swnOrdXNwIidTwhVARRGFOvEPgRirEEdPwZP062lK/mCMIA4xsg=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:51 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-9099a325-3e5e-4b16-bf20-0d61c7138a8f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for project 1df398dd4f844286b41ee4948001013a. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:26:51 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-9099a325-3e5e-4b16-bf20-0d61c7138a8f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for user 19dad04c158549c39991ea05fca2531d and project 1df398dd4f844286b41ee4948001013a. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:26:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9099a325-3e5e-4b16-bf20-0d61c7138a8f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046278 Apr 14 14:26:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 180/537] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:26:50 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1608636042", "imageRef": "9de2d251-ab11-4790-9d8b-f377d8e365bb", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-349171501", "networks": [{"uuid": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] validate_networks() for [('3e6dc6fc-92d7-4a9c-a3d4-6314555e6096', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:51 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-17dfc98e-3dd1-4e2b-9e14-63055591ea8f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1701 microversion: 2.1 time: 0.296758 Apr 14 14:26:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 181/538] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:51 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1701 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for project 1df398dd4f844286b41ee4948001013a. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting quotas for user 19dad04c158549c39991ea05fca2531d and project 1df398dd4f844286b41ee4948001013a. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:26:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9de2d251-ab11-4790-9d8b-f377d8e365bb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:26:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.818178 Apr 14 14:26:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 178/539] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:26:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:26:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d3e10d5e-7fc4-451d-9dd9-7e5d2f29b49c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d3e10d5e-7fc4-451d-9dd9-7e5d2f29b49c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-d3e10d5e-7fc4-451d-9dd9-7e5d2f29b49c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d3e10d5e-7fc4-451d-9dd9-7e5d2f29b49c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1252 microversion: 2.1 time: 0.062719 Apr 14 14:26:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 181/540] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:52 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1252 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-273cf4d0-29b2-4c00-bdf1-3cfdab316fbd tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.295449 Apr 14 14:26:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 182/541] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:26:52 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe/os-volume_attachments => generated 25 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:26:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 204 len: 0 microversion: 2.1 time: 0.115647 Apr 14 14:26:53 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 179/542] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:26:53 2023] DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-56557caa-2f5e-49d9-915f-73af5004591c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 200 len: 1668 microversion: 2.1 time: 0.285266 Apr 14 14:26:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 182/543] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:53 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "name": "network-vif-unplugged", "status": "completed", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Creating event network-vif-unplugged:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:26:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038492 Apr 14 14:26:53 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 180/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:54 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:26:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-31685297-932b-48b8-987d-515cfd2a24f1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1731 microversion: 2.1 time: 0.367589 Apr 14 14:26:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 183/545] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:26:53 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1731 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:26:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:54 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:54 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=25 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:26:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Creating event network-changed:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:26:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043144 Apr 14 14:26:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 183/546] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "name": "network-vif-plugged", "status": "completed", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}, {"server_uuid": "fafce4d3-18c4-4f15-af62-e599c7749efe", "name": "network-vif-deleted", "tag": "b3956c03-e69e-4181-940f-8e9e890b36ad"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Creating event network-vif-plugged:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:26:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Creating event network-vif-deleted:b3956c03-e69e-4181-940f-8e9e890b36ad for instance fafce4d3-18c4-4f15-af62-e599c7749efe on user Apr 14 14:26:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029892 Apr 14 14:26:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 181/547] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:57 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-plugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Creating event network-vif-plugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:26:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035538 Apr 14 14:26:57 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 184/548] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:26:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-plugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:26:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:26:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:26:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:26:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Creating event network-vif-plugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:26:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Apr 14 14:26:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 184/549] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] HTTP exception thrown: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Request method failure captured: Apr 14 14:27:21 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 HTTP/1.1 Apr 14 14:27:21 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:27:21 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:27:21 user devstack@n-api.service[61717]: Connection: close Apr 14 14:27:21 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:27:21 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:27:21 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:27:21 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:27:21 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWIl5hiJUuWVeTZk2I3d_74o_Og8QZJkoba21h4GTlwkAHzZX3U8KdtCLaOxXijrsL7B42bl_2uQIS9g5QiRT4wZaE_urr4jrns7quVBcjhhDcIqlmIvRA2ddAo_YzD3uz_uU1BWkgDfJzHTpQq_tHqwxByfJ3vEZ9X5xbW-U1-Zdjs Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Project-Id: cd6ef742f6534538a9452fe0d4ddce56 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Project-Name: tempest-VolumesActionsTest-1447608595 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd6ef742f6534538a9452fe0d4ddce56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd6ef742f6534538a9452fe0d4ddce56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd6ef742f6534538a9452fe0d4ddce56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Tenant: tempest-VolumesActionsTest-1447608595 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Tenant-Id: cd6ef742f6534538a9452fe0d4ddce56 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-VolumesActionsTest-1447608595 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-User: tempest-VolumesActionsTest-1447608595-project-member Apr 14 14:27:21 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:27:21 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:27:21 user devstack@n-api.service[61717]: X-User-Id: 2de5e6883ff54d049fba7810fe4f1f38 Apr 14 14:27:21 user devstack@n-api.service[61717]: X-User-Name: tempest-VolumesActionsTest-1447608595-project-member Apr 14 14:27:21 user devstack@n-api.service[61717]: method: > Apr 14 14:27:21 user devstack@n-api.service[61717]: exception: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. Apr 14 14:27:21 user devstack@n-api.service[61717]: action_args: {'id': '2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0'} Apr 14 14:27:21 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. Apr 14 14:27:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Returning 404 to user: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:27:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1b4d839b-9f85-4a93-a0cb-7173c2ffbe90 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" status: 404 len: 111 microversion: 2.1 time: 0.040843 Apr 14 14:27:21 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 182/550] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:21 2023] GET /compute/v2.1/servers/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:27:21 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:21 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=42 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1293967311", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "9edb5ed2-1710-4203-821d-23e54cf33690"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] validate_networks() for [('9edb5ed2-1710-4203-821d-23e54cf33690', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Getting quotas for project cd6ef742f6534538a9452fe0d4ddce56. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Getting quotas for user 2de5e6883ff54d049fba7810fe4f1f38 and project cd6ef742f6534538a9452fe0d4ddce56. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:27:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:27:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.858145 Apr 14 14:27:22 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 185/551] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:27:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:27:22 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:22 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:22 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:22 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8ca6ff9d-cb0c-445a-b4fb-4b4cfac99842 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:22 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8ca6ff9d-cb0c-445a-b4fb-4b4cfac99842 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:23 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-8ca6ff9d-cb0c-445a-b4fb-4b4cfac99842 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:23 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8ca6ff9d-cb0c-445a-b4fb-4b4cfac99842 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b" status: 200 len: 1208 microversion: 2.1 time: 0.210150 Apr 14 14:27:23 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 185/552] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:22 2023] GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b => generated 1208 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8b46a8ad-a034-4cb9-9622-455a1465a29d tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.474439 Apr 14 14:27:24 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 183/553] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:27:24 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-interface => generated 282 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Creating event network-changed:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:27:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038444 Apr 14 14:27:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 186/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b260ade-e92c-4dc6-8df7-54de936c6877"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387023 Apr 14 14:27:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 186/555] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:27:25 2023] POST /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba61f44-8536-4642-8d41-07ded8c58e1b", "tag": "80e312fb-30d9-4faa-9752-dedbe93524f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Creating event network-changed:80e312fb-30d9-4faa-9752-dedbe93524f1 for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b on user Apr 14 14:27:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155286 Apr 14 14:27:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 184/556] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba61f44-8536-4642-8d41-07ded8c58e1b", "name": "network-vif-plugged", "status": "completed", "tag": "80e312fb-30d9-4faa-9752-dedbe93524f1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Creating event network-vif-plugged:80e312fb-30d9-4faa-9752-dedbe93524f1 for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b on user Apr 14 14:27:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031169 Apr 14 14:27:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 187/557] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:30 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba61f44-8536-4642-8d41-07ded8c58e1b", "name": "network-vif-plugged", "status": "completed", "tag": "80e312fb-30d9-4faa-9752-dedbe93524f1"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:30 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Creating event network-vif-plugged:80e312fb-30d9-4faa-9752-dedbe93524f1 for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b on user Apr 14 14:27:30 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Apr 14 14:27:30 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 187/558] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:32 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-977ebc26-18dc-450a-b7ad-11319de9bc2a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1651 microversion: 2.20 time: 0.430405 Apr 14 14:27:32 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 185/559] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:27:32 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1651 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:33 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/action" status: 202 len: 0 microversion: 2.1 time: 0.398342 Apr 14 14:27:33 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 188/560] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:27:33 2023] POST /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-543c35f3-3599-498d-bc90-f40c86342369 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.217751 Apr 14 14:27:33 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 188/561] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:27:33 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-interface => generated 282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:34 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:27:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/action" status: 200 len: 32 microversion: 2.1 time: 0.329463 Apr 14 14:27:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 186/562] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:27:34 2023] POST /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:35 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:35 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c1c33a4b-0dae-4241-9163-07fab0ac552f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1723 microversion: 2.1 time: 1.514584 Apr 14 14:27:35 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 189/563] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:34 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1723 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:35 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:35 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:35 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:35 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:35 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Creating event network-vif-unplugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:27:35 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144710 Apr 14 14:27:35 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 189/564] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-unplugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Creating event network-vif-unplugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:27:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029972 Apr 14 14:27:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 187/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"name": "network-changed", "server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Creating event network-changed:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:27:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Creating event network-changed:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:27:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:27:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:27:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.039843 Apr 14 14:27:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 190/566] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:27:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049816 Apr 14 14:27:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 190/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:27:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028345 Apr 14 14:27:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 188/568] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}, {"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:27:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:27:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107784 Apr 14 14:27:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 191/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-986eb72d-7993-493c-9183-2f808ac5c2f6 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1536 microversion: 2.1 time: 0.257940 Apr 14 14:27:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 191/570] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:42 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1536 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:27:43 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe HTTP/1.1 Apr 14 14:27:43 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:27:43 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:27:43 user devstack@n-api.service[61717]: Connection: close Apr 14 14:27:43 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:27:43 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:27:43 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:27:43 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:27:43 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:27:43 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:27:43 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:27:43 user devstack@n-api.service[61717]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:27:43 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:27:43 user devstack@n-api.service[61717]: method: > Apr 14 14:27:43 user devstack@n-api.service[61717]: exception: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:27:43 user devstack@n-api.service[61717]: action_args: {'id': 'fafce4d3-18c4-4f15-af62-e599c7749efe'} Apr 14 14:27:43 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:27:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:27:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:27:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d88b0ef0-a30a-4ed2-9c55-de7e1bac296b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 404 len: 111 microversion: 2.1 time: 0.031157 Apr 14 14:27:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 189/571] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:43 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:27:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c7d57dd7-76c3-47fb-b489-ea28b53128cb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '.version_select at 0x7f67dfc61d80>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c7d57dd7-76c3-47fb-b489-ea28b53128cb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691574866" status: 202 len: 0 microversion: 2.1 time: 0.064294 Apr 14 14:27:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 192/572] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:27:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691574866 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 14:27:44 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b73006b9-c054-4386-9589-2cb64e8dc591 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: .version_select at 0x7f67dfd25090>, body: {"keypair": {"name": "tempest-keypair-1827852531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH77xmesvyrmE1nAACucYPHAK4jz+KuavjrQv5Px2cfKULQzmGdyTrtF5BDnN0G67IJwSYDCGCPSiqFhrETT+fyIeq+l5kZcow5VXI+HPlKRgVceDjHUIn5ctKoxERtfA=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:44 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-b73006b9-c054-4386-9589-2cb64e8dc591 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:27:44 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-b73006b9-c054-4386-9589-2cb64e8dc591 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:27:44 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b73006b9-c054-4386-9589-2cb64e8dc591 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067605 Apr 14 14:27:44 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 192/573] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:27:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-626f4c1b-ac9a-4d0f-a5ea-674a8132a993 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Action: 'create', calling method: .version_select at 0x7f67dfed7b50>, body: {"keypair": {"name": "tempest-TestStampPattern-594781561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:45 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-626f4c1b-ac9a-4d0f-a5ea-674a8132a993 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting quotas for project 51e043301622414bb492b48f0c6366a2. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:27:45 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-626f4c1b-ac9a-4d0f-a5ea-674a8132a993 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting quotas for user b5bccb6643e84c53ab7f1301bdf0cb97 and project 51e043301622414bb492b48f0c6366a2. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:27:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-626f4c1b-ac9a-4d0f-a5ea-674a8132a993 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.314972 Apr 14 14:27:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 190/574] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:27:45 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-43491806", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "788caf36-1098-4d17-b6c9-0a12d0019dca"}], "security_groups": [{"name": "tempest-securitygroup--883898408"}], "key_name": "tempest-keypair-1827852531", "user_data": "}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:46 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] validate_networks() for [('788caf36-1098-4d17-b6c9-0a12d0019dca', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:27:47 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:27:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.900917 Apr 14 14:27:47 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 193/575] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:27:46 2023] POST /compute/v2.1/servers => generated 399 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:27:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-bc710720-2d36-42bd-bfd8-546c8f34da16 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:47 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-bc710720-2d36-42bd-bfd8-546c8f34da16 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-bc710720-2d36-42bd-bfd8-546c8f34da16 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-bc710720-2d36-42bd-bfd8-546c8f34da16 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 200 len: 1234 microversion: 2.1 time: 0.081612 Apr 14 14:27:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 193/576] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:47 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1757826084", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "key_name": "tempest-TestStampPattern-594781561", "security_groups": [{"name": "tempest-secgroup-smoke-368264380"}], "networks": [{"uuid": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] validate_networks() for [('0a80e6d9-254b-45d7-9f5c-6c710ab5efeb', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:27:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Creating event network-changed:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:27:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048796 Apr 14 14:27:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 194/577] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting quotas for project 51e043301622414bb492b48f0c6366a2. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting quotas for user b5bccb6643e84c53ab7f1301bdf0cb97 and project 51e043301622414bb492b48f0c6366a2. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:27:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:27:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.180785 Apr 14 14:27:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 191/578] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:27:49 2023] POST /compute/v2.1/servers => generated 403 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:27:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-96af18e2-4694-4a1e-9b20-bc15b49743e3 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-96af18e2-4694-4a1e-9b20-bc15b49743e3 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:51 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-96af18e2-4694-4a1e-9b20-bc15b49743e3 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-96af18e2-4694-4a1e-9b20-bc15b49743e3 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85" status: 200 len: 1236 microversion: 2.1 time: 0.071106 Apr 14 14:27:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 194/579] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:51 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:52 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:52 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'services' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:27:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-volume_attachments/7c4e8847-0aac-4a87-8a83-09a33dabcca1" status: 202 len: 0 microversion: 2.1 time: 0.329545 Apr 14 14:27:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 195/580] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:27:51 2023] DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-volume_attachments/7c4e8847-0aac-4a87-8a83-09a33dabcca1 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:27:53 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "name": "network-vif-plugged", "status": "completed", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Creating event network-vif-plugged:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:27:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045368 Apr 14 14:27:53 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 192/581] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/action" status: 202 len: 0 microversion: 2.1 time: 0.350607 Apr 14 14:27:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 195/582] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:27:54 2023] POST /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:54 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e2cf60c4-b42f-4246-88af-63d53c2b73b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1730 microversion: 2.1 time: 0.316204 Apr 14 14:27:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 196/583] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:54 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "name": "network-vif-plugged", "status": "completed", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}, {"name": "network-changed", "server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Creating event network-vif-plugged:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:27:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Creating event network-changed:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:27:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036363 Apr 14 14:27:55 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 193/584] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:55 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:55 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Going to try to stop instance {{(pid=61718) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 14:27:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action" status: 202 len: 0 microversion: 2.1 time: 0.093040 Apr 14 14:27:55 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 196/585] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:27:55 2023] POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Creating event network-vif-unplugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:27:55 user devstack@n-api.service[61717]: DEBUG nova.compute.api [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:27:55 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058353 Apr 14 14:27:55 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 194/586] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:56 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:27:56 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2291fdf5-a365-4705-9b0f-210e38033449 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1665 microversion: 2.1 time: 0.424715 Apr 14 14:27:56 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 197/587] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:27:55 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1665 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:27:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "name": "network-vif-plugged", "status": "completed", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Creating event network-vif-plugged:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:27:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-unplugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}, {"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137113 Apr 14 14:27:57 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 197/588] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Creating event network-vif-unplugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:27:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:27:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039746 Apr 14 14:27:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 195/589] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:27:57 user devstack@n-api.service[61716]: DEBUG nova.compute.api [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:27:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053353 Apr 14 14:27:57 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 198/590] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:27:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "name": "network-vif-plugged", "status": "completed", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:27:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:27:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:27:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:27:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Creating event network-vif-plugged:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:27:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031835 Apr 14 14:27:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 198/591] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:27:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=7 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:08 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'services' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:28:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments/ee4fd548-c01c-41ed-a231-433d83cb29da" status: 202 len: 0 microversion: 2.1 time: 0.230175 Apr 14 14:28:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 196/592] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:28:07 2023] DELETE /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments/ee4fd548-c01c-41ed-a231-433d83cb29da => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=5 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:08 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-0392054d-a52d-448c-83ed-91415a471407 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066458 Apr 14 14:28:08 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 199/593] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:28:08 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:28:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61718) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:28:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102151 Apr 14 14:28:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 199/594] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:12 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:28:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037971 Apr 14 14:28:12 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 197/595] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:13 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f84e875f-4126-4bf5-ae60-701ab7448a27 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b" status: 200 len: 1486 microversion: 2.1 time: 0.248932 Apr 14 14:28:13 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 200/596] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:13 2023] GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b => generated 1486 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:25 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:25 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:26 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e3c7725b-c97e-4cd6-84db-76a397c554df tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1703 microversion: 2.1 time: 0.509418 Apr 14 14:28:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:25 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1703 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c68292f-0341-4d10-81d2-79511834b3d8"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-283a5b36-bdfd-4676-bd99-55e99f85473c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.404517 Apr 14 14:28:33 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 198/598] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 14:28:32 2023] POST /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-volume_attachments => generated 188 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=12 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:33 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6071e19d-7a3f-4d1e-aca8-463d5fb4f5dc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-volume_attachments/8c68292f-0341-4d10-81d2-79511834b3d8" status: 202 len: 0 microversion: 2.20 time: 0.262178 Apr 14 14:28:33 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 201/599] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 14:28:33 2023] DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-volume_attachments/8c68292f-0341-4d10-81d2-79511834b3d8 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:33 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61718) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 14:28:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/action" status: 202 len: 0 microversion: 2.20 time: 0.195003 Apr 14 14:28:33 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 201/600] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:28:33 2023] POST /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:34 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:34 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:34 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a83eb654-efc8-43d9-aa86-e59f944c5ee9 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1659 microversion: 2.20 time: 0.278259 Apr 14 14:28:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 199/601] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:28:33 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1659 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:28:36 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:36 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Creating event network-changed:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:28:36 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032200 Apr 14 14:28:36 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 202/602] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:37 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-71e74fdf-4c77-4f42-b359-dc71e2388152 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 200 len: 1543 microversion: 2.1 time: 0.224486 Apr 14 14:28:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 202/603] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:37 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 1543 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:41 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-773b402f-590a-4eb6-a7bf-fe2f3097dc2b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85" status: 200 len: 1537 microversion: 2.1 time: 0.248039 Apr 14 14:28:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 200/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:41 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:42 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-01357c61-4989-46ad-ab2a-5b8711178ec4 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1536 microversion: 2.1 time: 0.414018 Apr 14 14:28:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 203/605] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:42 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1536 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Searching by: {'deleted': False, 'project_id': '1df398dd4f844286b41ee4948001013a'} {{(pid=61718) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-plugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:43 user devstack@n-api.service[61718]: DEBUG nova.compute.multi_cell_list [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61718) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 14:28:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Creating event network-vif-plugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:28:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038135 Apr 14 14:28:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 201/606] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a348bf31-62e3-4682-a6f0-e0366256aba7 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.214681 Apr 14 14:28:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 203/607] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 14:28:42 2023] GET /compute/v2.1/servers => generated 341 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:43 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4c8d428f-a3c6-466a-932a-01af56298514 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1536 microversion: 2.1 time: 0.204283 Apr 14 14:28:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 204/608] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:43 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1536 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:45 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-plugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Creating event network-vif-plugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:28:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032514 Apr 14 14:28:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 204/609] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:45 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-bc6c3a13-f587-45b0-b83d-aae76dac83ef tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1723 microversion: 2.1 time: 0.335334 Apr 14 14:28:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 202/610] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:44 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f94c09b-5ac0-4fcb-81f1-996b7e7aed32"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:46 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-92152295-0090-470c-b629-f8ebffa6ed77 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1642 microversion: 2.1 time: 0.246635 Apr 14 14:28:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 205/611] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:46 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1642 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 14:28:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351706 Apr 14 14:28:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 205/612] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:28:46 2023] POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:54 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-747c73cd-384a-46d0-88cb-b5ce5b2f2ccb tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1582 microversion: 2.1 time: 0.238985 Apr 14 14:28:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 203/613] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:54 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1582 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Creating event network-changed:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:28:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 Apr 14 14:28:55 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 206/614] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-52738617"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:57 user devstack@n-api.service[61718]: INFO nova.network.security_group_api [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Adding security group b64d98fc-54b9-451a-aa02-ed79075fcaa1 to port 017c2389-4552-4847-9195-84fe74787c99 Apr 14 14:28:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-98944df1-87a0-465f-96f4-9ce4d3554740 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/action" status: 202 len: 0 microversion: 2.1 time: 0.663333 Apr 14 14:28:57 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 206/615] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:28:57 2023] POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:57 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:57 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Creating event network-changed:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:28:57 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Apr 14 14:28:57 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 207/616] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:28:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:28:57 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8717a668-276c-4eb9-97f4-2977e7fce8bd tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1745 microversion: 2.1 time: 0.162283 Apr 14 14:28:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 204/617] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:57 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/action" status: 202 len: 0 microversion: 2.1 time: 0.092782 Apr 14 14:28:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 207/618] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:28:58 2023] POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:28:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:28:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-04458c6a-120f-4976-a645-fff926f47748 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051458 Apr 14 14:28:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 205/619] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:28:58 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:28:58 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:28:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5d54770a-ab89-44c9-ad8b-802b530b218a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1737 microversion: 2.1 time: 0.206829 Apr 14 14:28:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 208/620] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:28:58 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-unplugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Creating event network-vif-unplugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:29:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f88ea55c-e1f7-421f-b6ae-cea8dd1c28b8 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '.version_select at 0x7f67dfdca440>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033310 Apr 14 14:29:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 208/621] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f88ea55c-e1f7-421f-b6ae-cea8dd1c28b8 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f" status: 204 len: 0 microversion: 2.1 time: 0.250084 Apr 14 14:29:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 206/622] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:01 2023] DELETE /compute/v2.1/images/32a818ca-b377-4b5e-8903-b6cf62547d0f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:29:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 204 len: 0 microversion: 2.1 time: 0.154447 Apr 14 14:29:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 209/623] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:29:01 2023] DELETE /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:02 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:02 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-748bc96f-3b06-41f8-a426-452f46a8919f tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 200 len: 1677 microversion: 2.1 time: 0.499661 Apr 14 14:29:02 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 209/624] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:02 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 1677 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:02 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Creating event network-vif-unplugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030555 Apr 14 14:29:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 207/625] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:03 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-plugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:03 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:03 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Creating event network-vif-plugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:29:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043586 Apr 14 14:29:03 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 210/626] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:04 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-deleted", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:04 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] Creating event network-vif-deleted:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:04 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053667 Apr 14 14:29:04 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 210/627] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:04 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}, {"server_uuid": "18a432a7-c206-4cf8-9718-7d5360d97f4e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a8af0-4a67-4942-9548-41928d3f3f5d"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:04 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=19 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:04 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Creating event network-vif-unplugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Creating event network-vif-plugged:fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e on user Apr 14 14:29:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036618 Apr 14 14:29:04 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 208/628] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:05 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-plugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}, {"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-plugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:05 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Creating event network-vif-plugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:29:05 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Creating event network-vif-plugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:29:05 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040125 Apr 14 14:29:05 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 211/629] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:14 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:29:14 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b" status: 204 len: 0 microversion: 2.1 time: 0.122943 Apr 14 14:29:14 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 211/630] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:29:13 2023] DELETE /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:14 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2937cde4-b1e5-4231-a5a7-5b3abd53929c tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b" status: 200 len: 1492 microversion: 2.1 time: 0.441169 Apr 14 14:29:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 209/631] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:14 2023] GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b => generated 1492 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:14 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba61f44-8536-4642-8d41-07ded8c58e1b", "name": "network-vif-unplugged", "status": "completed", "tag": "80e312fb-30d9-4faa-9752-dedbe93524f1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Creating event network-vif-unplugged:80e312fb-30d9-4faa-9752-dedbe93524f1 for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b on user Apr 14 14:29:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036036 Apr 14 14:29:14 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 212/632] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba61f44-8536-4642-8d41-07ded8c58e1b", "name": "network-vif-deleted", "tag": "80e312fb-30d9-4faa-9752-dedbe93524f1"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] Creating event network-vif-deleted:80e312fb-30d9-4faa-9752-dedbe93524f1 for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b on user Apr 14 14:29:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034414 Apr 14 14:29:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 212/633] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba61f44-8536-4642-8d41-07ded8c58e1b", "name": "network-vif-plugged", "status": "completed", "tag": "80e312fb-30d9-4faa-9752-dedbe93524f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:16 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Creating event network-vif-plugged:80e312fb-30d9-4faa-9752-dedbe93524f1 for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b on user Apr 14 14:29:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 Apr 14 14:29:16 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 210/634] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:24 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-dd6cc3c8-b639-48a9-abd4-f581941e131e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1704 microversion: 2.20 time: 0.240697 Apr 14 14:29:24 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 213/635] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:29:24 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1704 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] HTTP exception thrown: Cannot 'detach_volume' instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b while it is in vm_state rescued Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Request method failure captured: Apr 14 14:29:26 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments/6b260ade-e92c-4dc6-8df7-54de936c6877 HTTP/1.1 Apr 14 14:29:26 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:29:26 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:29:26 user devstack@n-api.service[61718]: Connection: close Apr 14 14:29:26 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:29:26 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:29:26 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:29:26 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:29:26 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBXzt78mFb8M3WWyp5BElUs3FxeYswY_G-byiClO1Ijhc9Ynmxu-dJA2BitefQNaaca8H_XNXfynEEuWJEc6y-_887v3iJjyNGVfuHYJKdKo-YNZBufoVreeU1iVR-XUREPKlJBt0Jkkx_8FwgbR0wBt6TXN-kLqEcZUfcIxALmmLg Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Project-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Tenant-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:29:26 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:29:26 user devstack@n-api.service[61718]: X-User: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:29:26 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:29:26 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:29:26 user devstack@n-api.service[61718]: X-User-Id: cdfcb787b0f545f8b19e947d54d07b9c Apr 14 14:29:26 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:29:26 user devstack@n-api.service[61718]: method: > Apr 14 14:29:26 user devstack@n-api.service[61718]: exception: Cannot 'detach_volume' instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b while it is in vm_state rescued Apr 14 14:29:26 user devstack@n-api.service[61718]: action_args: {'server_id': 'fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b', 'id': '6b260ade-e92c-4dc6-8df7-54de936c6877'} Apr 14 14:29:26 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b while it is in vm_state rescued Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b while it is in vm_state rescued Apr 14 14:29:26 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Returning 409 to user: Cannot 'detach_volume' instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b while it is in vm_state rescued {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:29:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-3c8fc894-4801-4ee2-acfc-8d801b1c9781 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments/6b260ade-e92c-4dc6-8df7-54de936c6877" status: 409 len: 152 microversion: 2.1 time: 0.101441 Apr 14 14:29:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 213/636] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:29:26 2023] DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments/6b260ade-e92c-4dc6-8df7-54de936c6877 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=5 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=9 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/action" status: 202 len: 0 microversion: 2.1 time: 0.080707 Apr 14 14:29:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 211/637] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:29:26 2023] POST /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:27 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ec38cb90-8712-4d6c-a43d-4796aa44d339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1711 microversion: 2.1 time: 0.233865 Apr 14 14:29:27 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 214/638] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:26 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1711 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:27 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-unplugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Creating event network-vif-unplugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:29:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029874 Apr 14 14:29:27 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 214/639] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:29 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}, {"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:29 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:29 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:29 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:29 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:29:29 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:29:29 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033442 Apr 14 14:29:29 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 212/640] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:29:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049206 Apr 14 14:29:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 215/641] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-64c73e52-38cc-47e5-a68a-c1478a51fab9 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.820690 Apr 14 14:29:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 215/642] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:29:37 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-interface => generated 283 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Creating event network-changed:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:29:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028856 Apr 14 14:29:39 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 213/643] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=12 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:39 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=20 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:29:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-818bffdb-b7ab-4fc6-ac2f-39a26c9722fb tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/ips" status: 200 len: 108 microversion: 2.1 time: 0.042623 Apr 14 14:29:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 216/644] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:29:39 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/ips => generated 108 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:41 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-dd688a83-b52a-4cf9-b3b1-8285608b3b0c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85" status: 200 len: 1537 microversion: 2.1 time: 0.216901 Apr 14 14:29:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 216/645] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:41 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a48016c4-11da-4f55-83f8-1104581bd49e"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283075 Apr 14 14:29:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 214/646] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:29:41 2023] POST /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Creating event network-changed:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:29:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030607 Apr 14 14:29:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 217/647] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e8ef61f-fc6b-47dc-99ad-79c2470ef08d"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303020 Apr 14 14:29:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 217/648] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:29:43 2023] POST /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:45 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-cba74dff-c301-4cb1-b253-59cd20e75527 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1723 microversion: 2.1 time: 0.294367 Apr 14 14:29:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 215/649] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:45 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:45 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3600526f-05c3-4555-86b9-b30f9e97f608 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1723 microversion: 2.1 time: 0.252474 Apr 14 14:29:45 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 218/650] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:45 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Going to try to start instance {{(pid=61718) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 14:29:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action" status: 202 len: 0 microversion: 2.1 time: 0.070501 Apr 14 14:29:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 218/651] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:29:46 2023] POST /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:46 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d2745184-bc62-4dc1-90a0-94d1d9104692 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1651 microversion: 2.1 time: 0.258724 Apr 14 14:29:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 216/652] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:46 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1651 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:48 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:29:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2ea5341e-6bea-43d4-8392-dfba9882dd8c tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1745 microversion: 2.1 time: 0.312834 Apr 14 14:29:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 219/653] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:48 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1745 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a48016c4-11da-4f55-83f8-1104581bd49e"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:29:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037728 Apr 14 14:29:49 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 217/654] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:49 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Invalid volume: volume a48016c4-11da-4f55-83f8-1104581bd49e is already attached to instances: 4fa04501-bc13-4309-b3a2-d972e2fc7c93 Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:29:49 user devstack@n-api.service[61718]: request: POST /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments HTTP/1.1 Apr 14 14:29:49 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:29:49 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:29:49 user devstack@n-api.service[61718]: Connection: close Apr 14 14:29:49 user devstack@n-api.service[61718]: Content-Length: 74 Apr 14 14:29:49 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:29:49 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:29:49 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:29:49 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:29:49 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:29:49 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:29:49 user devstack@n-api.service[61718]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:29:49 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:29:49 user devstack@n-api.service[61718]: Apr 14 14:29:49 user devstack@n-api.service[61718]: {"volumeAttachment": {"volumeId": "a48016c4-11da-4f55-83f8-1104581bd49e"}} Apr 14 14:29:49 user devstack@n-api.service[61718]: method: > Apr 14 14:29:49 user devstack@n-api.service[61718]: exception: Invalid volume: volume a48016c4-11da-4f55-83f8-1104581bd49e is already attached to instances: 4fa04501-bc13-4309-b3a2-d972e2fc7c93 Apr 14 14:29:49 user devstack@n-api.service[61718]: action_args: {'server_id': '4fa04501-bc13-4309-b3a2-d972e2fc7c93', 'body': {'volumeAttachment': {'volumeId': 'a48016c4-11da-4f55-83f8-1104581bd49e'}}} Apr 14 14:29:49 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a48016c4-11da-4f55-83f8-1104581bd49e is already attached to instances: 4fa04501-bc13-4309-b3a2-d972e2fc7c93 Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a48016c4-11da-4f55-83f8-1104581bd49e is already attached to instances: 4fa04501-bc13-4309-b3a2-d972e2fc7c93 Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a48016c4-11da-4f55-83f8-1104581bd49e is already attached to instances: 4fa04501-bc13-4309-b3a2-d972e2fc7c93 Apr 14 14:29:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:29:49 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 400 to user: Invalid volume: volume a48016c4-11da-4f55-83f8-1104581bd49e is already attached to instances: 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:29:49 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-daaa71dc-c911-4bb8-a922-435e2b23d529 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143526 Apr 14 14:29:49 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 219/655] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:29:49 2023] POST /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:50 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'services' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:29:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments/a48016c4-11da-4f55-83f8-1104581bd49e" status: 202 len: 0 microversion: 2.1 time: 0.263925 Apr 14 14:29:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 220/656] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:29:49 2023] DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments/a48016c4-11da-4f55-83f8-1104581bd49e => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8030b089-e835-425e-821c-7ac8306ffb3d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054752 Apr 14 14:29:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 218/657] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:29:50 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:29:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:29:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:29:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034876 Apr 14 14:29:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 220/658] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] HTTP exception thrown: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Request method failure captured: Apr 14 14:29:52 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e HTTP/1.1 Apr 14 14:29:52 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:29:52 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:29:52 user devstack@n-api.service[61716]: Connection: close Apr 14 14:29:52 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:29:52 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:29:52 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:29:52 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:29:52 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWF5aN7i84PmNj-uYpP1Us_PjDq37IFvnSz1ROrA5b1S75iEn3zj44XbPTtEoAsHtYTE0orFIfjvBAotDUPJMxl7ni3dtO2PB60L3v9kiLu2mvUGkuNg45ghPH7zigtp0EnRJh2VGh9s-y8rnyapS1lDRDKo6ztWGoMs42XGBt2O_vo Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Project-Id: 08b661ed41a346a487e0b47ce2c2af13 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerStableDeviceRescueTest-339063849 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08b661ed41a346a487e0b47ce2c2af13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/08b661ed41a346a487e0b47ce2c2af13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/08b661ed41a346a487e0b47ce2c2af13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerStableDeviceRescueTest-339063849 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Tenant-Id: 08b661ed41a346a487e0b47ce2c2af13 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-339063849 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-User: tempest-ServerStableDeviceRescueTest-339063849-project-member Apr 14 14:29:52 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:29:52 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:29:52 user devstack@n-api.service[61716]: X-User-Id: f64d891eb758466888e7ca9550994511 Apr 14 14:29:52 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerStableDeviceRescueTest-339063849-project-member Apr 14 14:29:52 user devstack@n-api.service[61716]: method: > Apr 14 14:29:52 user devstack@n-api.service[61716]: exception: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. Apr 14 14:29:52 user devstack@n-api.service[61716]: action_args: {'id': '18a432a7-c206-4cf8-9718-7d5360d97f4e'} Apr 14 14:29:52 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. Apr 14 14:29:52 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:29:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Returning 404 to user: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:29:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4c040ac5-c3a8-4bdb-a160-b01df0f604eb tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e" status: 404 len: 111 microversion: 2.1 time: 0.045881 Apr 14 14:29:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 221/659] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:29:52 2023] GET /compute/v2.1/servers/18a432a7-c206-4cf8-9718-7d5360d97f4e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:29:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-3d3d2c01-8c16-4b34-8095-9f3a0b8bcce8 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Calling method '.version_select at 0x7f67dfdc8ca0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-3d3d2c01-8c16-4b34-8095-9f3a0b8bcce8 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665568620" status: 202 len: 0 microversion: 2.1 time: 0.022801 Apr 14 14:29:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 219/660] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:29:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665568620 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:53 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'services' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:29:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments/7e8ef61f-fc6b-47dc-99ad-79c2470ef08d" status: 202 len: 0 microversion: 2.1 time: 0.186191 Apr 14 14:29:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 221/661] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:29:53 2023] DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments/7e8ef61f-fc6b-47dc-99ad-79c2470ef08d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:29:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:29:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ca3e59cc-8cb8-494a-a91a-518ef924cc46 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056898 Apr 14 14:29:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 222/662] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:29:53 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:01 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-fac63825-5d6f-48d5-91d7-bec7be0368fb tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfed7520>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-fac63825-5d6f-48d5-91d7-bec7be0368fb tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e71cd74e-c8e0-49eb-b215-07050c755530" status: 200 len: 350 microversion: 2.1 time: 0.054753 Apr 14 14:30:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 220/663] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:30:01 2023] GET /compute/v2.1/os-volumes/e71cd74e-c8e0-49eb-b215-07050c755530 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:03 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=14 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:03 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ce530195-8532-4773-8699-12ac956cd85c tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfda8430>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ce530195-8532-4773-8699-12ac956cd85c tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b2b6b9d9-8833-43ef-909b-eec0cf218247" status: 200 len: 351 microversion: 2.1 time: 0.063311 Apr 14 14:30:03 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 222/664] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:30:03 2023] GET /compute/v2.1/os-volumes/b2b6b9d9-8833-43ef-909b-eec0cf218247 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=13 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] HTTP exception thrown: Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b could not be found. Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Request method failure captured: Apr 14 14:30:04 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b HTTP/1.1 Apr 14 14:30:04 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:30:04 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:30:04 user devstack@n-api.service[61716]: Connection: close Apr 14 14:30:04 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:30:04 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:30:04 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:30:04 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:30:04 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWIl5hiJUuWVeTZk2I3d_74o_Og8QZJkoba21h4GTlwkAHzZX3U8KdtCLaOxXijrsL7B42bl_2uQIS9g5QiRT4wZaE_urr4jrns7quVBcjhhDcIqlmIvRA2ddAo_YzD3uz_uU1BWkgDfJzHTpQq_tHqwxByfJ3vEZ9X5xbW-U1-Zdjs Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Project-Id: cd6ef742f6534538a9452fe0d4ddce56 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesActionsTest-1447608595 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd6ef742f6534538a9452fe0d4ddce56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cd6ef742f6534538a9452fe0d4ddce56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cd6ef742f6534538a9452fe0d4ddce56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesActionsTest-1447608595 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Tenant-Id: cd6ef742f6534538a9452fe0d4ddce56 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesActionsTest-1447608595 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-User: tempest-VolumesActionsTest-1447608595-project-member Apr 14 14:30:04 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:30:04 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:30:04 user devstack@n-api.service[61716]: X-User-Id: 2de5e6883ff54d049fba7810fe4f1f38 Apr 14 14:30:04 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesActionsTest-1447608595-project-member Apr 14 14:30:04 user devstack@n-api.service[61716]: method: > Apr 14 14:30:04 user devstack@n-api.service[61716]: exception: Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b could not be found. Apr 14 14:30:04 user devstack@n-api.service[61716]: action_args: {'id': '8ba61f44-8536-4642-8d41-07ded8c58e1b'} Apr 14 14:30:04 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b could not be found. Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b could not be found. Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b could not be found. Apr 14 14:30:04 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:30:04 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Returning 404 to user: Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:30:04 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-22b374f5-f275-4979-baef-80cfcf260e94 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b" status: 404 len: 111 microversion: 2.1 time: 0.210585 Apr 14 14:30:04 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 223/665] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:30:04 2023] GET /compute/v2.1/servers/8ba61f44-8536-4642-8d41-07ded8c58e1b => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:30:06 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-23a40db6-2d22-4ad0-b539-907a382f2879 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfdcaa70>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-23a40db6-2d22-4ad0-b539-907a382f2879 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1682ecc0-e5f8-44bf-a50b-14a5918a6a6c" status: 200 len: 351 microversion: 2.1 time: 0.057482 Apr 14 14:30:06 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 221/666] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:30:06 2023] GET /compute/v2.1/os-volumes/1682ecc0-e5f8-44bf-a50b-14a5918a6a6c => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ba2bb11d-8d06-4977-b2b6-73890651ea13 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfda9cf0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ba2bb11d-8d06-4977-b2b6-73890651ea13 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090743 Apr 14 14:30:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 223/667] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 14:30:06 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e3ba565f-e21c-4d61-886a-8fe899052653 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfd8e200>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:06 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e3ba565f-e21c-4d61-886a-8fe899052653 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092305 Apr 14 14:30:06 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 224/668] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 14:30:06 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:06 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-cfcccc73-1a63-48e0-89f9-38acef5227f7 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfc26dd0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:06 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-cfcccc73-1a63-48e0-89f9-38acef5227f7 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091274 Apr 14 14:30:06 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 222/669] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 14:30:06 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-87a2ada6-11e3-42d1-9cfb-1e1874c7ed69 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfd24430>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-87a2ada6-11e3-42d1-9cfb-1e1874c7ed69 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082747 Apr 14 14:30:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 224/670] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 14:30:06 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d6cda868-44cd-4625-b804-832dccd4f8fc tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfc62b00>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d6cda868-44cd-4625-b804-832dccd4f8fc tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094090 Apr 14 14:30:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 225/671] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 14:30:06 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-9e17c874-6cc4-4c31-a55b-6d06b42a7f19 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfc25b40>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-9e17c874-6cc4-4c31-a55b-6d06b42a7f19 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087699 Apr 14 14:30:07 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 223/672] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 14:30:07 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-45f38e27-9ba6-4446-9f01-d5a4fc193740 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dfda9ab0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-45f38e27-9ba6-4446-9f01-d5a4fc193740 tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085343 Apr 14 14:30:07 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 225/673] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 14:30:07 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-94ffc501-8d6d-4401-bf95-f1dc701a910f tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] Calling method '.version_select at 0x7f67dff4d5a0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-94ffc501-8d6d-4401-bf95-f1dc701a910f tempest-VolumesTestJSON-1867504584 tempest-VolumesTestJSON-1867504584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.079482 Apr 14 14:30:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 226/674] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 14:30:07 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:17 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:17 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b6527f3b-b3d9-40f5-b115-da8aad1ce395 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1717 microversion: 2.1 time: 0.314398 Apr 14 14:30:17 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 224/675] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:30:17 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1717 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-213cb736-839e-4d61-bdc4-de88f4d2ff47 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083403 Apr 14 14:30:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 226/676] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 14:30:24 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:24 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:30:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 204 len: 0 microversion: 2.20 time: 0.178363 Apr 14 14:30:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 227/677] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:30:24 2023] DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:25 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f87a00e0-3fc7-4b8b-8cf3-b631d0c1ffbe tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 200 len: 1710 microversion: 2.20 time: 0.262892 Apr 14 14:30:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 225/678] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:30:25 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 1710 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:30:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-unplugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Creating event network-vif-unplugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:30:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033080 Apr 14 14:30:25 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 227/679] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:27 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-deleted", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] Creating event network-vif-deleted:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:30:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035629 Apr 14 14:30:27 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 228/680] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:27 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e", "name": "network-vif-plugged", "status": "completed", "tag": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:27 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Creating event network-vif-plugged:72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e on user Apr 14 14:30:27 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Apr 14 14:30:27 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 226/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:37 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e8f40e7e-2788-4cc0-956b-2f0ec5c4f247 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1655 microversion: 2.1 time: 0.311599 Apr 14 14:30:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 228/682] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:30:36 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1655 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-50e77f0a-811e-430c-8978-c1f7718b0bea tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055713 Apr 14 14:30:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 229/683] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:30:40 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=14 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:40 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:30:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 204 len: 0 microversion: 2.1 time: 0.153221 Apr 14 14:30:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:30:40 2023] DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:40 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:40 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-aa392582-f533-4a01-990a-967a9cd1bbae tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 200 len: 1668 microversion: 2.1 time: 0.333385 Apr 14 14:30:40 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 229/685] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:30:40 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "name": "network-vif-unplugged", "status": "completed", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Creating event network-vif-unplugged:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:30:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046659 Apr 14 14:30:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 230/686] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "name": "network-vif-deleted", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] Creating event network-vif-deleted:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:30:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035221 Apr 14 14:30:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 228/687] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa04501-bc13-4309-b3a2-d972e2fc7c93", "name": "network-vif-plugged", "status": "completed", "tag": "4a9de01b-07a4-4bcf-933f-3d493bae2db1"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Creating event network-vif-plugged:4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 on user Apr 14 14:30:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043792 Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 230/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-116a1d49-4396-432d-bc4e-cfe05193aacb tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058753 Apr 14 14:30:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 231/689] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:30:43 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:45 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:30:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 204 len: 0 microversion: 2.1 time: 0.138301 Apr 14 14:30:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 229/690] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:30:45 2023] DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Creating event network-vif-unplugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:30:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032121 Apr 14 14:30:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 232/691] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:46 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-efc55674-2d43-492c-8699-75b22cf831ac tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 200 len: 1729 microversion: 2.1 time: 0.620354 Apr 14 14:30:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 231/692] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:30:46 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 1729 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-570292702"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:47 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/action" status: 202 len: 0 microversion: 2.1 time: 0.949758 Apr 14 14:30:47 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 230/693] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:30:46 2023] POST /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 14:30:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-deleted", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] Creating event network-vif-deleted:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:30:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032593 Apr 14 14:30:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 233/694] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e", "name": "network-vif-plugged", "status": "completed", "tag": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Creating event network-vif-plugged:2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e on user Apr 14 14:30:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034142 Apr 14 14:30:48 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 232/695] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-52738617"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:49 user devstack@n-api.service[61717]: INFO nova.network.security_group_api [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Removing security group b64d98fc-54b9-451a-aa02-ed79075fcaa1 from port 017c2389-4552-4847-9195-84fe74787c99 Apr 14 14:30:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-68beccae-0276-4969-9178-02673d556b39 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/action" status: 202 len: 0 microversion: 2.1 time: 1.432815 Apr 14 14:30:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 231/696] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:30:48 2023] POST /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/action => generated 0 bytes in 1435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:30:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Creating event network-changed:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:30:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Apr 14 14:30:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 234/697] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Creating event network-changed:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:30:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049935 Apr 14 14:30:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 232/698] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:52 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'services' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:30:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments/5f94c09b-5ac0-4fcb-81f1-996b7e7aed32" status: 202 len: 0 microversion: 2.1 time: 0.200119 Apr 14 14:30:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 233/699] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:30:52 2023] DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments/5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-61818e93-cc62-46e7-be65-f7826d8395ce tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054030 Apr 14 14:30:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 235/700] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:30:52 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-dc55a965-1588-420e-80e9-af9a9d086d5e tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Action: 'create', calling method: .version_select at 0x7f67dfc25510>, body: {"keypair": {"name": "tempest-TestShelveInstance-790180658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKJoKJ0C1gwmcl9WN0481R6riIzUurMmeNe4HFPJSFtnAOso9CjS53uyvJdMv1WXI2soZXZFuXATdLz+HY8o19OMrATVnZBHoN6oICfZYn1/7aJe4UeWOor3ZtbYKjF6A=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:57 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-dc55a965-1588-420e-80e9-af9a9d086d5e tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting quotas for project 8137fbeb0b0546eb9fd19b76bb8b6b7a. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:30:57 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-dc55a965-1588-420e-80e9-af9a9d086d5e tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting quotas for user bc2d448f2dfc45498252bab608df3446 and project 8137fbeb0b0546eb9fd19b76bb8b6b7a. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:30:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-dc55a965-1588-420e-80e9-af9a9d086d5e tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.227502 Apr 14 14:30:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 233/701] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:30:57 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:30:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-2070944659", "imageRef": "25145ae9-9290-432b-9bc8-6eb80cf99145", "flavorRef": "42", "key_name": "tempest-TestStampPattern-594781561", "security_groups": [{"name": "tempest-secgroup-smoke-368264380"}], "networks": [{"uuid": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] validate_networks() for [('0a80e6d9-254b-45d7-9f5c-6c710ab5efeb', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting quotas for project 51e043301622414bb492b48f0c6366a2. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting quotas for user b5bccb6643e84c53ab7f1301bdf0cb97 and project 51e043301622414bb492b48f0c6366a2. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:30:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='25145ae9-9290-432b-9bc8-6eb80cf99145',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:30:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.768437 Apr 14 14:30:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 234/702] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:30:57 2023] POST /compute/v2.1/servers => generated 403 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:30:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f2bf7709-c7eb-4b97-9ddc-8756f18175ea tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:30:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f2bf7709-c7eb-4b97-9ddc-8756f18175ea tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:30:58 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-f2bf7709-c7eb-4b97-9ddc-8756f18175ea tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:30:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f2bf7709-c7eb-4b97-9ddc-8756f18175ea tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7" status: 200 len: 1236 microversion: 2.1 time: 0.078127 Apr 14 14:30:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 236/703] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:30:58 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 14:31:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Creating event network-changed:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:31:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039859 Apr 14 14:31:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 234/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:02 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-755157756", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-790180658", "security_groups": [{"name": "tempest-secgroup-smoke-1068496566"}], "networks": [{"uuid": "1a30ed81-1d33-4eaa-95de-182342a5a2d4"}], "block_device_mapping_v2": [{"uuid": "1eb54abc-e5f8-4871-b539-2002d1b2a221", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:02 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] validate_networks() for [('1a30ed81-1d33-4eaa-95de-182342a5a2d4', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting quotas for project 8137fbeb0b0546eb9fd19b76bb8b6b7a. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting quotas for user bc2d448f2dfc45498252bab608df3446 and project 8137fbeb0b0546eb9fd19b76bb8b6b7a. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:31:03 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1eb54abc-e5f8-4871-b539-2002d1b2a221',volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:31:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.848888 Apr 14 14:31:03 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 235/705] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:31:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:31:03 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bea73de1-ed63-4ad5-b012-a8b8677f82fc tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:03 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bea73de1-ed63-4ad5-b012-a8b8677f82fc tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:03 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=26 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:03 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-bea73de1-ed63-4ad5-b012-a8b8677f82fc tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bea73de1-ed63-4ad5-b012-a8b8677f82fc tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1082 microversion: 2.1 time: 0.087690 Apr 14 14:31:03 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 237/706] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:03 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1082 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:31:03 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "name": "network-vif-plugged", "status": "completed", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:03 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Creating event network-vif-plugged:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:31:03 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039586 Apr 14 14:31:03 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 235/707] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "name": "network-vif-plugged", "status": "completed", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Creating event network-vif-plugged:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:31:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032705 Apr 14 14:31:05 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 236/708] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:06 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Creating event network-changed:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:31:06 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037328 Apr 14 14:31:06 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 238/709] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-plugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:13 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Creating event network-vif-plugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:31:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050276 Apr 14 14:31:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 236/710] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-plugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=12 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Creating event network-vif-plugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:31:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041731 Apr 14 14:31:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 237/711] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=25 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HTTP exception thrown: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Request method failure captured: Apr 14 14:31:15 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e HTTP/1.1 Apr 14 14:31:15 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:31:15 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:31:15 user devstack@n-api.service[61716]: Connection: close Apr 14 14:31:15 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:31:15 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:31:15 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:31:15 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:31:15 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBnVL98smIPP0Ij9Hk63fFPCem8SvJZvGAl8-ai3ZHw9HfwXbGatsKnuTXSfm3Yifi2mKB-8KYwgG4bxNBpkprUivuGpYBzzS52MqA7TusPpQp9h7jzhBeGZ_npujtAKjrOVe-OwWXAOA6m2CF6Tq4v1xiuk77bT3r4CoXkJnEETi0 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Project-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Tenant-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:15 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:31:15 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:31:15 user devstack@n-api.service[61716]: X-User-Id: a7a99d9a44334bfeb39f6684853f6844 Apr 14 14:31:15 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:15 user devstack@n-api.service[61716]: method: > Apr 14 14:31:15 user devstack@n-api.service[61716]: exception: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:15 user devstack@n-api.service[61716]: action_args: {'id': 'c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e'} Apr 14 14:31:15 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:15 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:15 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Returning 404 to user: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:15 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-19154cfd-cebe-41af-ac9b-9835a5514080 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 404 len: 111 microversion: 2.20 time: 0.047367 Apr 14 14:31:15 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 239/712] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:31:15 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:31:15 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4acd3892-15a6-4d77-b987-1035c865428e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '.version_select at 0x7f67dfed6d40>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4acd3892-15a6-4d77-b987-1035c865428e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428673856" status: 204 len: 0 microversion: 2.20 time: 0.031723 Apr 14 14:31:15 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 237/713] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 14:31:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428673856 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a82d5506-013f-4b3f-9220-552484c97125 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.191127 Apr 14 14:31:17 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 238/714] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:31:17 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-interface => generated 282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Creating event network-changed:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:31:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041322 Apr 14 14:31:19 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 240/715] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'services' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:31:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments/6b260ade-e92c-4dc6-8df7-54de936c6877" status: 202 len: 0 microversion: 2.1 time: 0.230057 Apr 14 14:31:19 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 238/716] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:31:19 2023] DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments/6b260ade-e92c-4dc6-8df7-54de936c6877 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HTTP exception thrown: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Request method failure captured: Apr 14 14:31:19 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e HTTP/1.1 Apr 14 14:31:19 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:31:19 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:31:19 user devstack@n-api.service[61716]: Connection: close Apr 14 14:31:19 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:31:19 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:31:19 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:31:19 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:31:19 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBnVL98smIPP0Ij9Hk63fFPCem8SvJZvGAl8-ai3ZHw9HfwXbGatsKnuTXSfm3Yifi2mKB-8KYwgG4bxNBpkprUivuGpYBzzS52MqA7TusPpQp9h7jzhBeGZ_npujtAKjrOVe-OwWXAOA6m2CF6Tq4v1xiuk77bT3r4CoXkJnEETi0 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Project-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Tenant-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:19 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:31:19 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:31:19 user devstack@n-api.service[61716]: X-User-Id: a7a99d9a44334bfeb39f6684853f6844 Apr 14 14:31:19 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:19 user devstack@n-api.service[61716]: method: > Apr 14 14:31:19 user devstack@n-api.service[61716]: exception: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61716]: action_args: {'id': 'c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e'} Apr 14 14:31:19 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-356f2fd6-3ac9-4693-86af-b4690f882ecd tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059487 Apr 14 14:31:19 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 239/717] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:31:19 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:19 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Returning 404 to user: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-46a2abc4-a8d2-4a65-89c0-52405c7e5916 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 404 len: 111 microversion: 2.20 time: 0.058224 Apr 14 14:31:19 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 241/718] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:31:19 2023] DELETE /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HTTP exception thrown: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Request method failure captured: Apr 14 14:31:19 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e HTTP/1.1 Apr 14 14:31:19 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:31:19 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:31:19 user devstack@n-api.service[61717]: Connection: close Apr 14 14:31:19 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:31:19 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:31:19 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:31:19 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:31:19 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBnVL98smIPP0Ij9Hk63fFPCem8SvJZvGAl8-ai3ZHw9HfwXbGatsKnuTXSfm3Yifi2mKB-8KYwgG4bxNBpkprUivuGpYBzzS52MqA7TusPpQp9h7jzhBeGZ_npujtAKjrOVe-OwWXAOA6m2CF6Tq4v1xiuk77bT3r4CoXkJnEETi0 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Project-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Tenant-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:19 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:31:19 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:31:19 user devstack@n-api.service[61717]: X-User-Id: a7a99d9a44334bfeb39f6684853f6844 Apr 14 14:31:19 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:19 user devstack@n-api.service[61717]: method: > Apr 14 14:31:19 user devstack@n-api.service[61717]: exception: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61717]: action_args: {'id': 'c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e'} Apr 14 14:31:19 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. Apr 14 14:31:19 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:19 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Returning 404 to user: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7e0bc66d-a33e-439c-bd24-7b0700aec110 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" status: 404 len: 111 microversion: 2.20 time: 0.058894 Apr 14 14:31:19 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 239/719] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:31:19 2023] GET /compute/v2.1/servers/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:31:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Creating event network-changed:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:31:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027987 Apr 14 14:31:21 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 240/720] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HTTP exception thrown: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Request method failure captured: Apr 14 14:31:22 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 HTTP/1.1 Apr 14 14:31:22 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:31:22 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:31:22 user devstack@n-api.service[61716]: Connection: close Apr 14 14:31:22 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:31:22 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:31:22 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:31:22 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:31:22 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBnVL98smIPP0Ij9Hk63fFPCem8SvJZvGAl8-ai3ZHw9HfwXbGatsKnuTXSfm3Yifi2mKB-8KYwgG4bxNBpkprUivuGpYBzzS52MqA7TusPpQp9h7jzhBeGZ_npujtAKjrOVe-OwWXAOA6m2CF6Tq4v1xiuk77bT3r4CoXkJnEETi0 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Project-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Tenant-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:22 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:31:22 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:31:22 user devstack@n-api.service[61716]: X-User-Id: a7a99d9a44334bfeb39f6684853f6844 Apr 14 14:31:22 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:22 user devstack@n-api.service[61716]: method: > Apr 14 14:31:22 user devstack@n-api.service[61716]: exception: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:22 user devstack@n-api.service[61716]: action_args: {'id': 'e81e92d6-b79e-46db-b69e-1f7584440287'} Apr 14 14:31:22 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:22 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Returning 404 to user: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4a91a3b7-a933-4aa6-aedb-52895fe52f6a tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 404 len: 111 microversion: 2.20 time: 0.030861 Apr 14 14:31:22 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 242/721] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:31:22 2023] DELETE /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HTTP exception thrown: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:23 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Request method failure captured: Apr 14 14:31:23 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 HTTP/1.1 Apr 14 14:31:23 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:31:23 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:31:23 user devstack@n-api.service[61717]: Connection: close Apr 14 14:31:23 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:31:23 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:31:23 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:31:23 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:31:23 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBnVL98smIPP0Ij9Hk63fFPCem8SvJZvGAl8-ai3ZHw9HfwXbGatsKnuTXSfm3Yifi2mKB-8KYwgG4bxNBpkprUivuGpYBzzS52MqA7TusPpQp9h7jzhBeGZ_npujtAKjrOVe-OwWXAOA6m2CF6Tq4v1xiuk77bT3r4CoXkJnEETi0 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Project-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8263321b4e34ea08350e97ac2a3a794"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Tenant-Id: b8263321b4e34ea08350e97ac2a3a794 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1666709251 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:23 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:31:23 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:31:23 user devstack@n-api.service[61717]: X-User-Id: a7a99d9a44334bfeb39f6684853f6844 Apr 14 14:31:23 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1666709251-project-member Apr 14 14:31:23 user devstack@n-api.service[61717]: method: > Apr 14 14:31:23 user devstack@n-api.service[61717]: exception: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:23 user devstack@n-api.service[61717]: action_args: {'id': 'e81e92d6-b79e-46db-b69e-1f7584440287'} Apr 14 14:31:23 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. Apr 14 14:31:23 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:23 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Returning 404 to user: Instance e81e92d6-b79e-46db-b69e-1f7584440287 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-385f5a2e-7580-4440-a8e9-7a470e61eddc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287" status: 404 len: 111 microversion: 2.20 time: 0.260461 Apr 14 14:31:23 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 240/722] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:31:22 2023] GET /compute/v2.1/servers/e81e92d6-b79e-46db-b69e-1f7584440287 => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 14:31:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d4a0b5d3-0f44-4fe4-85ff-4fa3fadb2489 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Action: 'create', calling method: .version_select at 0x7f67dfd24040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-856556337"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d4a0b5d3-0f44-4fe4-85ff-4fa3fadb2489 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.494767 Apr 14 14:31:29 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 241/723] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 14:31:28 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 497 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 14:31:29 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-45612353-b70e-4e95-a52b-09238289ddb6 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67e59ef9a0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-45612353-b70e-4e95-a52b-09238289ddb6 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 200 len: 344 microversion: 2.1 time: 0.075170 Apr 14 14:31:29 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 243/724] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:29 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0406249c-18ed-40b1-8b47-56ccb55de1e0 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfdca710>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0406249c-18ed-40b1-8b47-56ccb55de1e0 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 200 len: 344 microversion: 2.1 time: 0.055179 Apr 14 14:31:30 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 241/725] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:30 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:30 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:30 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:31:31 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 HTTP/1.1 Apr 14 14:31:31 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:31:31 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:31:31 user devstack@n-api.service[61718]: Connection: close Apr 14 14:31:31 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:31:31 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:31:31 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:31:31 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:31:31 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:31:31 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:31:31 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:31:31 user devstack@n-api.service[61718]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:31:31 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:31:31 user devstack@n-api.service[61718]: method: > Apr 14 14:31:31 user devstack@n-api.service[61718]: exception: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:31:31 user devstack@n-api.service[61718]: action_args: {'id': '4fa04501-bc13-4309-b3a2-d972e2fc7c93'} Apr 14 14:31:31 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:31:31 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-27df8228-c749-4f7a-aab9-6cdc2903d236 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 404 len: 111 microversion: 2.1 time: 0.033493 Apr 14 14:31:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 242/726] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:30 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d54205bb-20f7-4234-93bb-041232b3957e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '.version_select at 0x7f67dfc61fc0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d54205bb-20f7-4234-93bb-041232b3957e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827852531" status: 202 len: 0 microversion: 2.1 time: 0.023322 Apr 14 14:31:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 244/727] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:31:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827852531 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-67cd3ac2-212c-4933-a881-84545b4d0fc1 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfdcb010>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-67cd3ac2-212c-4933-a881-84545b4d0fc1 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 200 len: 345 microversion: 2.1 time: 0.050256 Apr 14 14:31:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 242/728] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:31 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5d9a8eb3-91de-4d43-af42-5cd493048508 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Action: 'create', calling method: .version_select at 0x7f67dfda9f30>, body: {"snapshot": {"volume_id": "da86a934-f2c1-4366-8976-1bf1a0f32060", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-649520805"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5d9a8eb3-91de-4d43-af42-5cd493048508 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.195910 Apr 14 14:31:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 243/729] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 14:31:31 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-fc2defb3-68c1-458c-a8d5-2de3825d1a1b tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dff4e680>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-fc2defb3-68c1-458c-a8d5-2de3825d1a1b tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.037372 Apr 14 14:31:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 245/730] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:31 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c7a3aa4c-16df-4d96-8320-d39008fc1555 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfdcbb50>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b4843e7d-4e15-4ef9-b30c-3ce217ba2389 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: .version_select at 0x7f67dfca2a70>, body: {"keypair": {"name": "tempest-keypair-1386274115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhFalSigEmM/qdeFp13swzmTqKkKdefyD8LEgpHWpeke9RVOd9xVI6DSJsz57YRHcM+YiKIpcv+9Xi/T4Xj+WbcZjFvIwe3H0tvDuHt0gBs4Mt8I3sT+uJbbG8uU5tag=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c7a3aa4c-16df-4d96-8320-d39008fc1555 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.057799 Apr 14 14:31:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 243/731] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 14:31:31 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec774c56-28e1-47e0-aefa-f320be121fc4 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfd33eb0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-b4843e7d-4e15-4ef9-b30c-3ce217ba2389 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:31:31 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-b4843e7d-4e15-4ef9-b30c-3ce217ba2389 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:31:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b4843e7d-4e15-4ef9-b30c-3ce217ba2389 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046449 Apr 14 14:31:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ec774c56-28e1-47e0-aefa-f320be121fc4 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.034756 Apr 14 14:31:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 244/732] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:31:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 246/733] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:31 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:32 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-cee3a72f-ce72-4f2f-92d8-edaca1f780a0 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfdc8940>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-cee3a72f-ce72-4f2f-92d8-edaca1f780a0 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.034555 Apr 14 14:31:32 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 244/734] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:32 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1099630364", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "788caf36-1098-4d17-b6c9-0a12d0019dca"}], "security_groups": [{"name": "tempest-securitygroup--762782143"}], "key_name": "tempest-keypair-1386274115", "user_data": "}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] validate_networks() for [('788caf36-1098-4d17-b6c9-0a12d0019dca', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:31:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:33 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f8d2d6f3-91f6-4da3-9ce2-e83073036e97 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfc61750>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:33 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f8d2d6f3-91f6-4da3-9ce2-e83073036e97 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.039342 Apr 14 14:31:33 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 247/735] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:33 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting quotas for user 5db83169bedc4520b5e2a2b595362ec1 and project df56fb88b961464496757a358fd15169. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:31:33 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:31:34 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.641903 Apr 14 14:31:34 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 245/736] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:31:33 2023] POST /compute/v2.1/servers => generated 399 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:31:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:34 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-67f2470a-269d-4ddc-9942-951fd8689a36 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:34 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-67f2470a-269d-4ddc-9942-951fd8689a36 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:34 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-67f2470a-269d-4ddc-9942-951fd8689a36 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-67f2470a-269d-4ddc-9942-951fd8689a36 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 200 len: 1236 microversion: 2.1 time: 0.082610 Apr 14 14:31:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 245/737] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:34 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:31:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b7e173b7-0879-454d-ad92-578ca209c0d5 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfd329e0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b7e173b7-0879-454d-ad92-578ca209c0d5 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 287 microversion: 2.1 time: 0.047194 Apr 14 14:31:34 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 248/738] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:34 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:34 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b28a4d0d-9851-4c6d-bfbb-0c283e6f4b8b tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfdab130>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:35 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b28a4d0d-9851-4c6d-bfbb-0c283e6f4b8b tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 202 len: 0 microversion: 2.1 time: 0.112315 Apr 14 14:31:35 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 246/739] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 14:31:34 2023] DELETE /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:31:35 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-322a00f3-c78f-497f-b19d-24d50912a27f tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfdcab90>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:35 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-322a00f3-c78f-497f-b19d-24d50912a27f tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.045019 Apr 14 14:31:35 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 246/740] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:35 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:36 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d3575b80-57e4-40a7-9a23-f7787d73f515 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfd8c700>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:36 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d3575b80-57e4-40a7-9a23-f7787d73f515 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.051976 Apr 14 14:31:36 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 249/741] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:36 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:31:36 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e HTTP/1.1 Apr 14 14:31:36 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:31:36 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:31:36 user devstack@n-api.service[61718]: Connection: close Apr 14 14:31:36 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:31:36 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:31:36 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:31:36 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:31:36 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:31:36 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:36 user devstack@n-api.service[61718]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:31:36 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:31:36 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:31:36 user devstack@n-api.service[61718]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:31:36 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:31:36 user devstack@n-api.service[61718]: method: > Apr 14 14:31:36 user devstack@n-api.service[61718]: exception: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61718]: action_args: {'id': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'} Apr 14 14:31:36 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a0a7aaff-5abd-419f-8306-d911e2e6a6b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 404 len: 111 microversion: 2.1 time: 0.040297 Apr 14 14:31:36 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 247/742] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:36 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:31:36 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments HTTP/1.1 Apr 14 14:31:36 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:31:36 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:31:36 user devstack@n-api.service[61717]: Connection: close Apr 14 14:31:36 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:31:36 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:31:36 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:31:36 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:31:36 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:31:36 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:36 user devstack@n-api.service[61717]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:31:36 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:31:36 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:31:36 user devstack@n-api.service[61717]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:31:36 user devstack@n-api.service[61717]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:31:36 user devstack@n-api.service[61717]: method: > Apr 14 14:31:36 user devstack@n-api.service[61717]: exception: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61717]: action_args: {'server_id': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'} Apr 14 14:31:36 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:36 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-41fc39ce-b848-488b-867f-b45f906e1ded tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038063 Apr 14 14:31:36 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 247/743] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:31:36 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:31:37 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e HTTP/1.1 Apr 14 14:31:37 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:31:37 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:31:37 user devstack@n-api.service[61716]: Connection: close Apr 14 14:31:37 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:31:37 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:31:37 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:31:37 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:31:37 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:31:37 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:31:37 user devstack@n-api.service[61716]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:31:37 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:31:37 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:31:37 user devstack@n-api.service[61716]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:31:37 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:31:37 user devstack@n-api.service[61716]: method: > Apr 14 14:31:37 user devstack@n-api.service[61716]: exception: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:37 user devstack@n-api.service[61716]: action_args: {'id': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'} Apr 14 14:31:37 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:31:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3ec880d9-099c-4213-a002-f7114b99641a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 404 len: 111 microversion: 2.1 time: 0.041826 Apr 14 14:31:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 250/744] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:37 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d03295a7-9db9-43e8-88ae-08416cdaabe4 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfd25870>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1361343797", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "3d9490f5-8130-426e-9126-f2edafc77fbe"}], "security_groups": [{"name": "tempest-securitygroup--1851558202"}], "key_name": "tempest-keypair-220938053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d03295a7-9db9-43e8-88ae-08416cdaabe4 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 200 len: 286 microversion: 2.1 time: 0.042079 Apr 14 14:31:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 248/745] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:37 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Creating event network-changed:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:31:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041346 Apr 14 14:31:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 251/746] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:37 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] validate_networks() for [('3d9490f5-8130-426e-9126-f2edafc77fbe', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-055970f9-57c7-4e70-84f0-f039a6c36e43 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043737 Apr 14 14:31:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 249/747] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:31:37 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:31:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 204 len: 0 microversion: 2.1 time: 0.117754 Apr 14 14:31:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 252/748] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:31:37 2023] DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:38 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-222af31c-8654-4fbd-95da-61d1a8b20fb8 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 200 len: 1661 microversion: 2.1 time: 0.284110 Apr 14 14:31:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 250/749] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:37 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 1661 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:31:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f28041ce-933b-4f4d-9198-3779b963c70d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfc636d0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-f28041ce-933b-4f4d-9198-3779b963c70d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] HTTP exception thrown: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. Apr 14 14:31:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f28041ce-933b-4f4d-9198-3779b963c70d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Request method failure captured: Apr 14 14:31:38 user devstack@n-api.service[61716]: request: GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d HTTP/1.1 Apr 14 14:31:38 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:31:38 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:31:38 user devstack@n-api.service[61716]: Connection: close Apr 14 14:31:38 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:31:38 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:31:38 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:31:38 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:31:38 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWPAcCckX68Z5y80BWBJ0c5ZcjtGfXiNmOjtPddqLgWqM8Npgixswocc7PtaDgBsvrOwtYCeiqJoI48OBR253RyRIFUBt8GBsODsVC_yJRTSn7FO4nWxLEgXoJbiTHlVgPmex4G-dsKF7LSy4QEbSdkZC2PWarUdzPOGpQa0VWutph4 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Project-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e76301f794af47e48346f503b6924ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Tenant-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:38 user devstack@n-api.service[61716]: X-User: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:38 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:31:38 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:31:38 user devstack@n-api.service[61716]: X-User-Id: 16fae42e019a49d498be541fd9fdf78f Apr 14 14:31:38 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:38 user devstack@n-api.service[61716]: method: Apr 14 14:31:38 user devstack@n-api.service[61716]: exception: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. Apr 14 14:31:38 user devstack@n-api.service[61716]: action_args: {'id': 'c3b6e92b-4b29-461c-8978-94804e88ca2d'} Apr 14 14:31:38 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. (HTTP 404) (Request-ID: req-61c98652-86db-46ba-acfe-1be9c64305c5) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. Apr 14 14:31:38 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f28041ce-933b-4f4d-9198-3779b963c70d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Returning 404 to user: Snapshot c3b6e92b-4b29-461c-8978-94804e88ca2d could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f28041ce-933b-4f4d-9198-3779b963c70d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d" status: 404 len: 111 microversion: 2.1 time: 0.044364 Apr 14 14:31:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 253/750] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:31:38 2023] GET /compute/v2.1/os-snapshots/c3b6e92b-4b29-461c-8978-94804e88ca2d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5cc8c2e4-29da-4a8e-afc3-f5d1fa813798 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfda9510>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5cc8c2e4-29da-4a8e-afc3-f5d1fa813798 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 202 len: 0 microversion: 2.1 time: 0.120845 Apr 14 14:31:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 251/751] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:31:38 2023] DELETE /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:31:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-27b8d4b1-91f6-411f-91d7-24874b816347 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfd8c0d0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-27b8d4b1-91f6-411f-91d7-24874b816347 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 200 len: 344 microversion: 2.1 time: 0.064653 Apr 14 14:31:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 254/752] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:38 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:31:38 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:31:38 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.351848 Apr 14 14:31:38 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 248/753] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:31:37 2023] POST /compute/v2.1/servers => generated 404 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:31:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5437a1c4-aee5-4949-af63-b3e527bec14d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:38 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5437a1c4-aee5-4949-af63-b3e527bec14d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:38 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-5437a1c4-aee5-4949-af63-b3e527bec14d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5437a1c4-aee5-4949-af63-b3e527bec14d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577" status: 200 len: 1232 microversion: 2.1 time: 0.065190 Apr 14 14:31:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 252/754] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:38 2023] GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 => generated 1232 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:31:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-unplugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}, {"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-plugged", "status": "completed", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Creating event network-vif-unplugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:31:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Creating event network-vif-plugged:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:31:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047111 Apr 14 14:31:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 255/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2d577847-70b9-4ff0-b5db-559b69a721a9 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfe44dc0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2d577847-70b9-4ff0-b5db-559b69a721a9 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 200 len: 344 microversion: 2.1 time: 0.124032 Apr 14 14:31:39 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 249/756] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:39 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "name": "network-vif-plugged", "status": "completed", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:40 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Creating event network-vif-plugged:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:31:40 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036135 Apr 14 14:31:40 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 253/757] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:31:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-85bcee9d-cf30-4d6c-84e1-9146e2a22775 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfcc1480>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-85bcee9d-cf30-4d6c-84e1-9146e2a22775 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 200 len: 344 microversion: 2.1 time: 0.086047 Apr 14 14:31:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 256/758] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:40 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3faeeb1-a50c-474b-b694-98c4d70435d5", "name": "network-vif-deleted", "tag": "693b3793-ec24-4c90-ba05-73d5e4eaa30f"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] Creating event network-vif-deleted:693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 on user Apr 14 14:31:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 Apr 14 14:31:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 250/759] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Creating event network-changed:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:31:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034449 Apr 14 14:31:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 254/760] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a9ee380a-238a-4788-bbc5-bc8591d73613 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfcc2b00>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-a9ee380a-238a-4788-bbc5-bc8591d73613 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] HTTP exception thrown: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a9ee380a-238a-4788-bbc5-bc8591d73613 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Request method failure captured: Apr 14 14:31:41 user devstack@n-api.service[61716]: request: GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 HTTP/1.1 Apr 14 14:31:41 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:31:41 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:31:41 user devstack@n-api.service[61716]: Connection: close Apr 14 14:31:41 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:31:41 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:31:41 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:31:41 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:31:41 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWPAcCckX68Z5y80BWBJ0c5ZcjtGfXiNmOjtPddqLgWqM8Npgixswocc7PtaDgBsvrOwtYCeiqJoI48OBR253RyRIFUBt8GBsODsVC_yJRTSn7FO4nWxLEgXoJbiTHlVgPmex4G-dsKF7LSy4QEbSdkZC2PWarUdzPOGpQa0VWutph4 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Project-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e76301f794af47e48346f503b6924ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Tenant-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61716]: X-User: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:41 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:31:41 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:31:41 user devstack@n-api.service[61716]: X-User-Id: 16fae42e019a49d498be541fd9fdf78f Apr 14 14:31:41 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:41 user devstack@n-api.service[61716]: method: Apr 14 14:31:41 user devstack@n-api.service[61716]: exception: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61716]: action_args: {'id': 'da86a934-f2c1-4366-8976-1bf1a0f32060'} Apr 14 14:31:41 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. (HTTP 404) (Request-ID: req-f5f18533-910b-4300-8f74-51ace5ef2a88) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a9ee380a-238a-4788-bbc5-bc8591d73613 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Returning 404 to user: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a9ee380a-238a-4788-bbc5-bc8591d73613 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 404 len: 109 microversion: 2.1 time: 0.043795 Apr 14 14:31:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 257/761] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:41 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e6bca580-b571-41d5-82e0-2f68f87f4bc7 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfe467a0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-e6bca580-b571-41d5-82e0-2f68f87f4bc7 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] HTTP exception thrown: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e6bca580-b571-41d5-82e0-2f68f87f4bc7 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Request method failure captured: Apr 14 14:31:41 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 HTTP/1.1 Apr 14 14:31:41 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:31:41 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:31:41 user devstack@n-api.service[61717]: Connection: close Apr 14 14:31:41 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:31:41 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:31:41 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:31:41 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:31:41 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWPAcCckX68Z5y80BWBJ0c5ZcjtGfXiNmOjtPddqLgWqM8Npgixswocc7PtaDgBsvrOwtYCeiqJoI48OBR253RyRIFUBt8GBsODsVC_yJRTSn7FO4nWxLEgXoJbiTHlVgPmex4G-dsKF7LSy4QEbSdkZC2PWarUdzPOGpQa0VWutph4 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Project-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e76301f794af47e48346f503b6924ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Tenant-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61717]: X-User: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:41 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:31:41 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:31:41 user devstack@n-api.service[61717]: X-User-Id: 16fae42e019a49d498be541fd9fdf78f Apr 14 14:31:41 user devstack@n-api.service[61717]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:41 user devstack@n-api.service[61717]: method: Apr 14 14:31:41 user devstack@n-api.service[61717]: exception: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61717]: action_args: {'id': 'da86a934-f2c1-4366-8976-1bf1a0f32060'} Apr 14 14:31:41 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. (HTTP 404) (Request-ID: req-f96923c5-559d-4bd8-8ca9-df079232f128) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e6bca580-b571-41d5-82e0-2f68f87f4bc7 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Returning 404 to user: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e6bca580-b571-41d5-82e0-2f68f87f4bc7 tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 404 len: 109 microversion: 2.1 time: 0.059974 Apr 14 14:31:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 251/762] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:31:41 2023] DELETE /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86210300-53fd-49a6-aaaf-890c38794b6d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Calling method '.version_select at 0x7f67dfda8280>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-86210300-53fd-49a6-aaaf-890c38794b6d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] HTTP exception thrown: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86210300-53fd-49a6-aaaf-890c38794b6d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Request method failure captured: Apr 14 14:31:41 user devstack@n-api.service[61718]: request: GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 HTTP/1.1 Apr 14 14:31:41 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:31:41 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:31:41 user devstack@n-api.service[61718]: Connection: close Apr 14 14:31:41 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:31:41 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:31:41 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:31:41 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:31:41 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWPAcCckX68Z5y80BWBJ0c5ZcjtGfXiNmOjtPddqLgWqM8Npgixswocc7PtaDgBsvrOwtYCeiqJoI48OBR253RyRIFUBt8GBsODsVC_yJRTSn7FO4nWxLEgXoJbiTHlVgPmex4G-dsKF7LSy4QEbSdkZC2PWarUdzPOGpQa0VWutph4 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Project-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e76301f794af47e48346f503b6924ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e76301f794af47e48346f503b6924ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Tenant-Id: e76301f794af47e48346f503b6924ea9 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605106352 Apr 14 14:31:41 user devstack@n-api.service[61718]: X-User: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:41 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:31:41 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:31:41 user devstack@n-api.service[61718]: X-User-Id: 16fae42e019a49d498be541fd9fdf78f Apr 14 14:31:41 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605106352-project-member Apr 14 14:31:41 user devstack@n-api.service[61718]: method: Apr 14 14:31:41 user devstack@n-api.service[61718]: exception: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61718]: action_args: {'id': 'da86a934-f2c1-4366-8976-1bf1a0f32060'} Apr 14 14:31:41 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. (HTTP 404) (Request-ID: req-3a1ddfd6-bab0-4592-8d5d-ca34a197bf48) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. Apr 14 14:31:41 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86210300-53fd-49a6-aaaf-890c38794b6d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] Returning 404 to user: Volume da86a934-f2c1-4366-8976-1bf1a0f32060 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-86210300-53fd-49a6-aaaf-890c38794b6d tempest-VolumesSnapshotsTestJSON-605106352 tempest-VolumesSnapshotsTestJSON-605106352-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060" status: 404 len: 109 microversion: 2.1 time: 0.046054 Apr 14 14:31:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 255/763] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:31:41 2023] GET /compute/v2.1/os-volumes/da86a934-f2c1-4366-8976-1bf1a0f32060 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "name": "network-vif-plugged", "status": "completed", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Creating event network-vif-plugged:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:31:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060122 Apr 14 14:31:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 258/764] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-2243abe6-5c44-4148-902d-d3fbc5407793 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052137 Apr 14 14:31:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 252/765] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:31:42 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HTTP exception thrown: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a is not attached to volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Request method failure captured: Apr 14 14:31:42 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments/5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 HTTP/1.1 Apr 14 14:31:42 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:31:42 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:31:42 user devstack@n-api.service[61718]: Connection: close Apr 14 14:31:42 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:31:42 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:31:42 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:31:42 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:31:42 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWE3luzi1Kmg8L-WniG6lCLe55O0X22ilshlP8DOegDb8kckADGnd3lD7qU-8TnTEQSjaDxU8dWbcsgzkNlPLzPc3Hmdcs7AYvYyWvLMdc3_fNgLFKHdW-P14me35-UUQJXkOfcQd7HJEIkUEBA2nXbFD3XGsq1fCG2YP0ZXmnhkyS4 Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Project-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Project-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1df398dd4f844286b41ee4948001013a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Tenant: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Tenant-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:31:42 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:31:42 user devstack@n-api.service[61718]: X-User: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:31:42 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:31:42 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:31:42 user devstack@n-api.service[61718]: X-User-Id: 19dad04c158549c39991ea05fca2531d Apr 14 14:31:42 user devstack@n-api.service[61718]: X-User-Name: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:31:42 user devstack@n-api.service[61718]: method: > Apr 14 14:31:42 user devstack@n-api.service[61718]: exception: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a is not attached to volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 Apr 14 14:31:42 user devstack@n-api.service[61718]: action_args: {'server_id': '5e419ecb-c1e3-4713-a190-62a7f220d01a', 'id': '5f94c09b-5ac0-4fcb-81f1-996b7e7aed32'} Apr 14 14:31:42 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32. Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a is not attached to volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a is not attached to volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 Apr 14 14:31:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:31:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Returning 404 to user: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a is not attached to volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:31:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-29fb3758-33d8-42a4-816b-9e7051891cf0 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments/5f94c09b-5ac0-4fcb-81f1-996b7e7aed32" status: 404 len: 154 microversion: 2.1 time: 0.091985 Apr 14 14:31:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 256/766] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:31:42 2023] DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a/os-volume_attachments/5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:31:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "name": "network-vif-plugged", "status": "completed", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Creating event network-vif-plugged:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:31:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063486 Apr 14 14:31:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 259/767] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "name": "network-vif-plugged", "status": "completed", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Creating event network-vif-plugged:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:31:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033148 Apr 14 14:31:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 253/768] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:31:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 204 len: 0 microversion: 2.1 time: 0.141461 Apr 14 14:31:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 257/769] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:31:46 2023] DELETE /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-unplugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Creating event network-vif-unplugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:31:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050852 Apr 14 14:31:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 254/770] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:47 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2b655a85-d044-4cc6-8252-ed3df05a6623 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 200 len: 1542 microversion: 2.1 time: 0.616570 Apr 14 14:31:47 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 260/771] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:46 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 1542 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=12 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:48 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:48 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:48 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:31:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-plugged", "status": "completed", "tag": "017c2389-4552-4847-9195-84fe74787c99"}, {"server_uuid": "5e419ecb-c1e3-4713-a190-62a7f220d01a", "name": "network-vif-deleted", "tag": "017c2389-4552-4847-9195-84fe74787c99"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:31:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Creating event network-vif-plugged:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:31:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Creating event network-vif-deleted:017c2389-4552-4847-9195-84fe74787c99 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a on user Apr 14 14:31:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045541 Apr 14 14:31:48 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 255/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:31:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:31:49 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:49 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-60c0138b-86a5-4dcb-a367-c8dacad1760d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7" status: 200 len: 1538 microversion: 2.1 time: 0.290157 Apr 14 14:31:49 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 258/773] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:48 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 => generated 1538 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:31:53 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:31:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f09a8077-a68e-45f1-a32b-f612d67d8f53 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1433 microversion: 2.1 time: 0.234025 Apr 14 14:31:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 261/774] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:31:53 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1433 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=18 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-cc42114e-f7f9-4c9a-9315-a9fa6e8f4a4f tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048733 Apr 14 14:32:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 256/775] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:32:09 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=5 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:32:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 204 len: 0 microversion: 2.1 time: 0.125515 Apr 14 14:32:09 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 259/776] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:32:09 2023] DELETE /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:09 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:10 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c9e48192-d224-42c9-9924-7907f0af4e53 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 200 len: 1677 microversion: 2.1 time: 0.386335 Apr 14 14:32:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 262/777] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:09 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 1677 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-unplugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Creating event network-vif-unplugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:32:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035024 Apr 14 14:32:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 257/778] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-plugged", "status": "completed", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}, {"server_uuid": "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b", "name": "network-vif-deleted", "tag": "72e0d4cc-2ecb-438e-97d0-faf165fef862"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:12 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Creating event network-vif-plugged:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:32:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Creating event network-vif-deleted:72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b on user Apr 14 14:32:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055470 Apr 14 14:32:12 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 260/779] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:24 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-11ab7dfe-1188-4959-9b9a-ff61925b8e8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 200 len: 1545 microversion: 2.1 time: 0.478673 Apr 14 14:32:24 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 263/780] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:24 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 1545 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HTTP exception thrown: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Request method failure captured: Apr 14 14:32:28 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 HTTP/1.1 Apr 14 14:32:28 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:32:28 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:32:28 user devstack@n-api.service[61717]: Connection: close Apr 14 14:32:28 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:32:28 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:32:28 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:32:28 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:32:28 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWGK5qCydKE5wUJiaNcLOEEGJEg5VGRG8LjJkWcsdYx0Z33NnAf96bPckCr0dKWQCbjpT82igar-bXFQ8ktmeas0gNVkAekyAhqbsKfFILBtFDqSCoDw-MqpeAhtiZHxi4tlhGTI8zzAmTTINgBGWiTL79eApk3xGZEfffkiTIKLEzU Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Project-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Tenant-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:32:28 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:32:28 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:32:28 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:32:28 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:32:28 user devstack@n-api.service[61717]: X-User-Id: 303cb0475ae74f328ee503d1e9d1f652 Apr 14 14:32:28 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:32:28 user devstack@n-api.service[61717]: method: > Apr 14 14:32:28 user devstack@n-api.service[61717]: exception: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:32:28 user devstack@n-api.service[61717]: action_args: {'id': 'a3faeeb1-a50c-474b-b694-98c4d70435d5'} Apr 14 14:32:28 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:32:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:32:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Returning 404 to user: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:32:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6ab4c038-1788-424d-bcd8-63e4ce6118b1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 404 len: 111 microversion: 2.1 time: 0.035911 Apr 14 14:32:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 258/781] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:28 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:32:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7b06ed21-b757-4b1f-bddf-0ba61246c14c tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '.version_select at 0x7f67dfda8ca0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-7b06ed21-b757-4b1f-bddf-0ba61246c14c tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819910287" status: 202 len: 0 microversion: 2.1 time: 0.034251 Apr 14 14:32:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 261/782] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:32:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819910287 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:29 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8786a0f1-9d63-445f-8370-67698b88aec0 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577" status: 200 len: 1540 microversion: 2.1 time: 0.352549 Apr 14 14:32:29 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 264/783] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:28 2023] GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 => generated 1540 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:29 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-12e4f903-f5ef-4a65-8d5f-17acfdbfc956 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: .version_select at 0x7f67dfdc9c60>, body: {"keypair": {"name": "tempest-keypair-279292969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6nxE5S1wXirRhC6sEEE9KneN1kwn9K9fmRcCO+E3aGgJS7fOW4IODElILe/Gx+GrA+9S/8eA0xwx1qi2r/F+/PatQ9TQz4wa3zRf8GGvnMpfgt6aeLXG9WeRnJTDpeAg=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:29 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-12e4f903-f5ef-4a65-8d5f-17acfdbfc956 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:32:29 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-12e4f903-f5ef-4a65-8d5f-17acfdbfc956 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for user 303cb0475ae74f328ee503d1e9d1f652 and project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:32:29 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-12e4f903-f5ef-4a65-8d5f-17acfdbfc956 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050671 Apr 14 14:32:29 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 259/784] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:32:29 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-53779625", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e74c25a5-d089-40ed-9f3f-6d838da07564"}], "security_groups": [{"name": "tempest-securitygroup--692230684"}], "key_name": "tempest-keypair-279292969", "user_data": "}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] validate_networks() for [('e74c25a5-d089-40ed-9f3f-6d838da07564', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting quotas for user 303cb0475ae74f328ee503d1e9d1f652 and project 6dd9adda27714cf5b55203d8d76de05a. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:32:31 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:32:31 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.679680 Apr 14 14:32:31 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 262/785] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:32:31 2023] POST /compute/v2.1/servers => generated 399 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:32:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2db4feac-6305-4568-bd17-d2e53d94af25 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:31 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2db4feac-6305-4568-bd17-d2e53d94af25 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:31 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-2db4feac-6305-4568-bd17-d2e53d94af25 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2db4feac-6305-4568-bd17-d2e53d94af25 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 200 len: 1229 microversion: 2.1 time: 0.068136 Apr 14 14:32:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 265/786] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:31 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 1229 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:34 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba499ef-3621-4516-875f-492eef042874", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Creating event network-changed:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:32:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096442 Apr 14 14:32:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 260/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba499ef-3621-4516-875f-492eef042874", "name": "network-vif-plugged", "status": "completed", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Creating event network-vif-plugged:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:32:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331499 Apr 14 14:32:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 263/788] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HTTP exception thrown: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a could not be found. Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Request method failure captured: Apr 14 14:32:37 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a HTTP/1.1 Apr 14 14:32:37 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:32:37 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:32:37 user devstack@n-api.service[61716]: Connection: close Apr 14 14:32:37 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:32:37 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:32:37 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:32:37 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:32:37 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWE3luzi1Kmg8L-WniG6lCLe55O0X22ilshlP8DOegDb8kckADGnd3lD7qU-8TnTEQSjaDxU8dWbcsgzkNlPLzPc3Hmdcs7AYvYyWvLMdc3_fNgLFKHdW-P14me35-UUQJXkOfcQd7HJEIkUEBA2nXbFD3XGsq1fCG2YP0ZXmnhkyS4 Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Project-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1df398dd4f844286b41ee4948001013a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1df398dd4f844286b41ee4948001013a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Tenant: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Tenant-Id: 1df398dd4f844286b41ee4948001013a Apr 14 14:32:37 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-248098662 Apr 14 14:32:37 user devstack@n-api.service[61716]: X-User: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:32:37 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:32:37 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:32:37 user devstack@n-api.service[61716]: X-User-Id: 19dad04c158549c39991ea05fca2531d Apr 14 14:32:37 user devstack@n-api.service[61716]: X-User-Name: tempest-TestMinimumBasicScenario-248098662-project-member Apr 14 14:32:37 user devstack@n-api.service[61716]: method: > Apr 14 14:32:37 user devstack@n-api.service[61716]: exception: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a could not be found. Apr 14 14:32:37 user devstack@n-api.service[61716]: action_args: {'id': '5e419ecb-c1e3-4713-a190-62a7f220d01a'} Apr 14 14:32:37 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a could not be found. Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a could not be found. Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a could not be found. Apr 14 14:32:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:32:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Returning 404 to user: Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:32:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-983196b4-387f-4693-b6bd-1abca17134cf tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a" status: 404 len: 111 microversion: 2.1 time: 0.043980 Apr 14 14:32:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 266/789] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:37 2023] GET /compute/v2.1/servers/5e419ecb-c1e3-4713-a190-62a7f220d01a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:32:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4e76acdb-4b90-4302-a308-83ad7a62897a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Calling method '.version_select at 0x7f67dfdcb370>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4e76acdb-4b90-4302-a308-83ad7a62897a tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-349171501" status: 202 len: 0 microversion: 2.1 time: 0.033875 Apr 14 14:32:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 261/790] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 14:32:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-349171501 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:32:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba499ef-3621-4516-875f-492eef042874", "name": "network-vif-plugged", "status": "completed", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Creating event network-vif-plugged:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:32:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032757 Apr 14 14:32:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 264/791] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=14 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:49 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:49 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-da232edd-071d-4554-8c7c-eef2c73bc655 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7" status: 200 len: 1538 microversion: 2.1 time: 0.463345 Apr 14 14:32:49 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 267/792] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:49 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 => generated 1538 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Creating event network-changed:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:32:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044274 Apr 14 14:32:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 262/793] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4669eb74-f961-4f6a-91c0-a9a14285ba7c"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312411 Apr 14 14:32:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 265/794] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:32:51 2023] POST /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:54 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-31731e31-6bae-41b6-b9a0-00a600ed9c77 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1433 microversion: 2.1 time: 0.238065 Apr 14 14:32:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 268/795] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:53 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1433 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Creating event network-changed:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:32:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043475 Apr 14 14:32:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 263/796] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:56 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'flavor' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:32:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298/action" status: 202 len: 0 microversion: 2.1 time: 0.150887 Apr 14 14:32:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 266/797] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:32:56 2023] POST /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:56 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:32:56 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5d8151ae-2093-4305-ae25-175d4b3ffb33 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1439 microversion: 2.1 time: 0.199785 Apr 14 14:32:56 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 269/798] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:32:56 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1439 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-unplugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Creating event network-vif-unplugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:32:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107316 Apr 14 14:32:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 264/799] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Creating event network-changed:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:32:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039490 Apr 14 14:32:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 267/800] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-plugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:32:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Creating event network-vif-plugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:32:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028473 Apr 14 14:32:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 270/801] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:32:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:32:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:00 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'services' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:33:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments/4669eb74-f961-4f6a-91c0-a9a14285ba7c" status: 202 len: 0 microversion: 2.1 time: 0.234231 Apr 14 14:33:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 265/802] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:32:59 2023] DELETE /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments/4669eb74-f961-4f6a-91c0-a9a14285ba7c => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-df3b2531-6463-4dfc-a1d0-7356ee2d2132 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051116 Apr 14 14:33:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 268/803] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:33:00 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] HTTP exception thrown: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b could not be found. Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Request method failure captured: Apr 14 14:33:00 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b HTTP/1.1 Apr 14 14:33:00 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:33:00 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:33:00 user devstack@n-api.service[61716]: Connection: close Apr 14 14:33:00 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:33:00 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:33:00 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:33:00 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:33:00 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBXzt78mFb8M3WWyp5BElUs3FxeYswY_G-byiClO1Ijhc9Ynmxu-dJA2BitefQNaaca8H_XNXfynEEuWJEc6y-_887v3iJjyNGVfuHYJKdKo-YNZBufoVreeU1iVR-XUREPKlJBt0Jkkx_8FwgbR0wBt6TXN-kLqEcZUfcIxALmmLg Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Project-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Tenant-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:33:00 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:33:00 user devstack@n-api.service[61716]: X-User: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:33:00 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:33:00 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:33:00 user devstack@n-api.service[61716]: X-User-Id: cdfcb787b0f545f8b19e947d54d07b9c Apr 14 14:33:00 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:33:00 user devstack@n-api.service[61716]: method: > Apr 14 14:33:00 user devstack@n-api.service[61716]: exception: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b could not be found. Apr 14 14:33:00 user devstack@n-api.service[61716]: action_args: {'id': 'fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b'} Apr 14 14:33:00 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b could not be found. Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b could not be found. Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b could not be found. Apr 14 14:33:00 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Returning 404 to user: Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:33:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-997cd4e3-4a1f-414b-9a3f-cccb1402335e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" status: 404 len: 111 microversion: 2.1 time: 0.041898 Apr 14 14:33:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 271/804] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:00 2023] GET /compute/v2.1/servers/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 14:33:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5ce329fe-04a2-4f14-b260-d7f4f7f09b84 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '.version_select at 0x7f67dfdcbd00>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5ce329fe-04a2-4f14-b260-d7f4f7f09b84 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178292711" status: 202 len: 0 microversion: 2.1 time: 0.160711 Apr 14 14:33:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 266/805] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:33:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178292711 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:07 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:33:07 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 204 len: 0 microversion: 2.1 time: 0.119045 Apr 14 14:33:07 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 269/806] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:33:07 2023] DELETE /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:07 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:08 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:33:08 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5caf74f9-0f00-4cd1-a2e5-7ad01d0b005b tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 200 len: 1492 microversion: 2.1 time: 0.378975 Apr 14 14:33:08 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 272/807] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:07 2023] GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 1492 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:33:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-unplugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Creating event network-vif-unplugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:33:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056347 Apr 14 14:33:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 267/808] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:09 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-deleted", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] Creating event network-vif-deleted:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:33:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047064 Apr 14 14:33:09 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 270/809] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7956b5-905e-4a1a-b657-fe3aa5018258", "name": "network-vif-plugged", "status": "completed", "tag": "9c5ceb2e-307c-4e1c-9356-b14b40e04290"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Creating event network-vif-plugged:9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 on user Apr 14 14:33:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033413 Apr 14 14:33:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 273/810] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:22 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:33:22 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d2cb1f37-28c8-4dc6-af41-132d4ff25ba1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 200 len: 1534 microversion: 2.1 time: 0.740089 Apr 14 14:33:22 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 268/811] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:21 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 1534 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-a38ee4a6-333d-40ca-9d84-c109b103f671 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.172370 Apr 14 14:33:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 271/812] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:33:24 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-interface => generated 283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:25 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=14 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:25 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=30 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Creating event network-changed:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:33:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055908 Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 274/813] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b4f28c91-695f-42ac-8684-de763b45de0c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/ips" status: 200 len: 108 microversion: 2.1 time: 0.048869 Apr 14 14:33:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 269/814] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:33:25 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/ips => generated 108 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa2ee2b-7a17-4118-ae50-075e9c02f9ba"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275676 Apr 14 14:33:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 272/815] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:33:28 2023] POST /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4ff6a65e-4992-4665-be8e-526410e7df74 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.353646 Apr 14 14:33:29 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 275/816] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:33:29 2023] GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577/os-interface => generated 283 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Creating event network-changed:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:33:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041168 Apr 14 14:33:30 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 270/817] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1842987954", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "3d9490f5-8130-426e-9126-f2edafc77fbe"}], "security_groups": [{"name": "tempest-securitygroup--1851558202"}], "key_name": "tempest-keypair-220938053", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] validate_networks() for [('3d9490f5-8130-426e-9126-f2edafc77fbe', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:33:34 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1',volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:33:35 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.061775 Apr 14 14:33:35 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 273/818] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:33:33 2023] POST /compute/v2.1/servers => generated 404 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:33:35 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d5066051-1f2f-4a0b-ac28-50a5fa1fc8e2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:35 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-d5066051-1f2f-4a0b-ac28-50a5fa1fc8e2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:35 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-d5066051-1f2f-4a0b-ac28-50a5fa1fc8e2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:33:35 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d5066051-1f2f-4a0b-ac28-50a5fa1fc8e2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1075 microversion: 2.1 time: 0.087701 Apr 14 14:33:35 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 276/819] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:35 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1075 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:36 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'services' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:33:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments/4aa2ee2b-7a17-4118-ae50-075e9c02f9ba" status: 202 len: 0 microversion: 2.1 time: 0.220418 Apr 14 14:33:36 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 271/820] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:33:36 2023] DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments/4aa2ee2b-7a17-4118-ae50-075e9c02f9ba => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-6d9739c1-ca39-49e4-ad0a-505bd616cc51 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056982 Apr 14 14:33:36 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 274/821] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:33:36 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Creating event network-changed:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:33:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Apr 14 14:33:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 277/822] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-plugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Creating event network-vif-plugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:33:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036491 Apr 14 14:33:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 272/823] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-plugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:46 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:46 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Creating event network-vif-plugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:33:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033751 Apr 14 14:33:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 275/824] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:46 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:33:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-089344b3-4ff2-4316-bf1f-d02583de1aaa tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1499 microversion: 2.1 time: 0.246501 Apr 14 14:33:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 278/825] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:46 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1499 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-50ee1e93-21ef-42b2-9c0a-453c1556dbbf tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044527 Apr 14 14:33:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 273/826] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:33:50 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Creating event network-changed:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:33:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027456 Apr 14 14:33:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 279/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:33:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7" status: 204 len: 0 microversion: 2.1 time: 0.122352 Apr 14 14:33:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 276/828] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:33:51 2023] DELETE /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "name": "network-vif-unplugged", "status": "completed", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:52 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:33:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:52 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-23808a61-1879-4219-b8dc-3a37c1030400 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7" status: 200 len: 1662 microversion: 2.1 time: 1.097004 Apr 14 14:33:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 274/829] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:51 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 => generated 1662 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:33:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Creating event network-vif-unplugged:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:33:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035507 Apr 14 14:33:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 280/830] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "name": "network-vif-deleted", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] Creating event network-vif-deleted:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:33:52 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029803 Apr 14 14:33:52 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 277/831] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a6c9af-12a8-440a-b27c-701fc24da3f7", "name": "network-vif-plugged", "status": "completed", "tag": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:54 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=15 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Creating event network-vif-plugged:8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 on user Apr 14 14:33:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029924 Apr 14 14:33:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 275/832] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=17 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=19 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] HTTP exception thrown: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Request method failure captured: Apr 14 14:33:58 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 HTTP/1.1 Apr 14 14:33:58 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:33:58 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:33:58 user devstack@n-api.service[61716]: Connection: close Apr 14 14:33:58 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:33:58 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:33:58 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:33:58 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:33:58 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBXzt78mFb8M3WWyp5BElUs3FxeYswY_G-byiClO1Ijhc9Ynmxu-dJA2BitefQNaaca8H_XNXfynEEuWJEc6y-_887v3iJjyNGVfuHYJKdKo-YNZBufoVreeU1iVR-XUREPKlJBt0Jkkx_8FwgbR0wBt6TXN-kLqEcZUfcIxALmmLg Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Project-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Tenant-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:33:58 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:33:58 user devstack@n-api.service[61716]: X-User: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:33:58 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:33:58 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:33:58 user devstack@n-api.service[61716]: X-User-Id: cdfcb787b0f545f8b19e947d54d07b9c Apr 14 14:33:58 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:33:58 user devstack@n-api.service[61716]: method: > Apr 14 14:33:58 user devstack@n-api.service[61716]: exception: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. Apr 14 14:33:58 user devstack@n-api.service[61716]: action_args: {'id': '7c7956b5-905e-4a1a-b657-fe3aa5018258'} Apr 14 14:33:58 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. Apr 14 14:33:58 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Returning 404 to user: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:33:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3bd0b346-82c4-4a2f-be21-a3e3340db7a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258" status: 404 len: 111 microversion: 2.1 time: 0.155661 Apr 14 14:33:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 281/833] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:58 2023] GET /compute/v2.1/servers/7c7956b5-905e-4a1a-b657-fe3aa5018258 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:33:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:33:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 204 len: 0 microversion: 2.1 time: 0.126975 Apr 14 14:33:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 278/834] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:33:58 2023] DELETE /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-unplugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:33:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:33:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Creating event network-vif-unplugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:33:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043745 Apr 14 14:33:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 282/835] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:33:58 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:33:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8bf7c470-c78f-4265-b37f-508fde7f8785 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 200 len: 1509 microversion: 2.1 time: 0.341484 Apr 14 14:33:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 276/836] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:33:58 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:34:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-plugged", "status": "completed", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}, {"server_uuid": "30643f90-4347-4b1e-b1ca-57e69e716fb4", "name": "network-vif-deleted", "tag": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Creating event network-vif-plugged:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:34:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Creating event network-vif-deleted:1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 on user Apr 14 14:34:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029951 Apr 14 14:34:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 279/837] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:22 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e473a6b8-7dda-446b-883e-1e28f191f112 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.312457 Apr 14 14:34:22 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 283/838] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:34:22 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-interface => generated 283 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=9 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:23 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba499ef-3621-4516-875f-492eef042874", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Creating event network-changed:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:34:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031861 Apr 14 14:34:23 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 277/839] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c22f05bc-8e64-4e4c-8b2e-34957019f8c4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/ips" status: 200 len: 144 microversion: 2.1 time: 0.043956 Apr 14 14:34:25 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 280/840] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 14:34:25 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:25 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:34:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7fc2de76-1689-405d-99ff-72ff0bf3f693 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1428 microversion: 2.1 time: 0.245868 Apr 14 14:34:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 284/841] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:25 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1428 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b9c04d50-8ebb-49e3-a3de-d7705b2c3318 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043041 Apr 14 14:34:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 278/842] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:34:26 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:26 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:34:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 204 len: 0 microversion: 2.1 time: 0.414037 Apr 14 14:34:27 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 281/843] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:34:26 2023] DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38d3efe2-64e7-4338-bf17-40c6053527e9"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:27 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "name": "network-vif-unplugged", "status": "completed", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:27 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:34:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-d63788af-4cf4-4d5e-ab4b-775e860cf9f4 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 200 len: 1670 microversion: 2.1 time: 0.440759 Apr 14 14:34:27 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 285/844] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:27 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 1670 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:34:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Creating event network-vif-unplugged:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:34:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035894 Apr 14 14:34:27 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 282/845] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:27 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275620 Apr 14 14:34:27 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 279/846] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:34:27 2023] POST /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "name": "network-vif-deleted", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] Creating event network-vif-deleted:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:34:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028686 Apr 14 14:34:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 286/847] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:29 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680", "name": "network-vif-plugged", "status": "completed", "tag": "f7107c4c-5255-44d3-bb66-e89affe36f75"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Creating event network-vif-plugged:f7107c4c-5255-44d3-bb66-e89affe36f75 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 on user Apr 14 14:34:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 Apr 14 14:34:29 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 283/848] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:35 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:35 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1ec649fd-4bbf-4780-a8d8-a87de153c6b9 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068507 Apr 14 14:34:35 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 280/849] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:34:35 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:35 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6bf804ab-e6d2-447c-8358-0315ab4303d4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/38d3efe2-64e7-4338-bf17-40c6053527e9" status: 200 len: 194 microversion: 2.1 time: 0.054428 Apr 14 14:34:35 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 287/850] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 14:34:35 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/38d3efe2-64e7-4338-bf17-40c6053527e9 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc9cf91c-7eeb-44f2-807e-8ec378a901f9"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262146 Apr 14 14:34:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 284/851] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:34:38 2023] POST /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] HTTP exception thrown: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Request method failure captured: Apr 14 14:34:42 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 HTTP/1.1 Apr 14 14:34:42 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:34:42 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:34:42 user devstack@n-api.service[61717]: Connection: close Apr 14 14:34:42 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:34:42 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:34:42 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:34:42 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:34:42 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWLZMRi3cUwEa6bI1hOnS_XGTRxBb_CtMVzjVWUr3T2uHfD18OBA7y4QzfiPpXtICC7nf83VythPVB150Qf30ACR2Fw4kI-RMexNK2KGmzQxQwZYTlkuTCurF4KGH6Qi9EtKxxEmkl_72paJcl2DTBesMoFTVfush8HAmP_1Ld6o2bA Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Project-Id: 51e043301622414bb492b48f0c6366a2 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestStampPattern-523457803 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51e043301622414bb492b48f0c6366a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51e043301622414bb492b48f0c6366a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51e043301622414bb492b48f0c6366a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Tenant: tempest-TestStampPattern-523457803 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Tenant-Id: 51e043301622414bb492b48f0c6366a2 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestStampPattern-523457803 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-User: tempest-TestStampPattern-523457803-project-member Apr 14 14:34:42 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:34:42 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:34:42 user devstack@n-api.service[61717]: X-User-Id: b5bccb6643e84c53ab7f1301bdf0cb97 Apr 14 14:34:42 user devstack@n-api.service[61717]: X-User-Name: tempest-TestStampPattern-523457803-project-member Apr 14 14:34:42 user devstack@n-api.service[61717]: method: > Apr 14 14:34:42 user devstack@n-api.service[61717]: exception: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. Apr 14 14:34:42 user devstack@n-api.service[61717]: action_args: {'id': '95a6c9af-12a8-440a-b27c-701fc24da3f7'} Apr 14 14:34:42 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. Apr 14 14:34:42 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Returning 404 to user: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:34:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d690b905-0000-47e7-ae19-899ad7428df8 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7" status: 404 len: 111 microversion: 2.1 time: 0.031952 Apr 14 14:34:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 281/852] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:42 2023] GET /compute/v2.1/servers/95a6c9af-12a8-440a-b27c-701fc24da3f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=24 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:45 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-71fb5226-323d-43bc-b95c-51448e4f4522 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.072626 Apr 14 14:34:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 288/853] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:34:45 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:46 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:46 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ba718a8e-36fa-4282-905c-cfa3ba1c9731 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/38d3efe2-64e7-4338-bf17-40c6053527e9" status: 200 len: 194 microversion: 2.1 time: 0.041772 Apr 14 14:34:46 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 285/854] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 14:34:46 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/38d3efe2-64e7-4338-bf17-40c6053527e9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:46 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'services' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:34:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/38d3efe2-64e7-4338-bf17-40c6053527e9" status: 202 len: 0 microversion: 2.1 time: 0.191728 Apr 14 14:34:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 282/855] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:34:46 2023] DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/38d3efe2-64e7-4338-bf17-40c6053527e9 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:47 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61716) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 14:34:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298/action" status: 202 len: 0 microversion: 2.1 time: 0.532506 Apr 14 14:34:47 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 289/856] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:34:46 2023] POST /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:34:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b6d2fa6f-9040-4e99-a4b1-d0736e3b4798 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1507 microversion: 2.1 time: 0.269180 Apr 14 14:34:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 286/857] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:47 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-3ad27fa9-a811-4a8f-8c99-9cfe61e0d0a6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/cc9cf91c-7eeb-44f2-807e-8ec378a901f9" status: 200 len: 194 microversion: 2.1 time: 0.044117 Apr 14 14:34:48 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 283/858] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 14:34:48 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/cc9cf91c-7eeb-44f2-807e-8ec378a901f9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:48 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'services' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:34:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/cc9cf91c-7eeb-44f2-807e-8ec378a901f9" status: 202 len: 0 microversion: 2.1 time: 0.164687 Apr 14 14:34:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 290/859] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:34:48 2023] DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments/cc9cf91c-7eeb-44f2-807e-8ec378a901f9 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:48 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] HTTP exception thrown: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 could not be found. Apr 14 14:34:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Request method failure captured: Apr 14 14:34:48 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 HTTP/1.1 Apr 14 14:34:48 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:34:48 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:34:48 user devstack@n-api.service[61718]: Connection: close Apr 14 14:34:48 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:34:48 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:34:48 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:34:48 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:34:48 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBXzt78mFb8M3WWyp5BElUs3FxeYswY_G-byiClO1Ijhc9Ynmxu-dJA2BitefQNaaca8H_XNXfynEEuWJEc6y-_887v3iJjyNGVfuHYJKdKo-YNZBufoVreeU1iVR-XUREPKlJBt0Jkkx_8FwgbR0wBt6TXN-kLqEcZUfcIxALmmLg Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Project-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b53efd997e3e47d898264dae8a27a5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Tenant-Id: b53efd997e3e47d898264dae8a27a5ad Apr 14 14:34:48 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1435712120 Apr 14 14:34:48 user devstack@n-api.service[61718]: X-User: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:34:48 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:34:48 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:34:48 user devstack@n-api.service[61718]: X-User-Id: cdfcb787b0f545f8b19e947d54d07b9c Apr 14 14:34:48 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1435712120-project-member Apr 14 14:34:48 user devstack@n-api.service[61718]: method: > Apr 14 14:34:48 user devstack@n-api.service[61718]: exception: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 could not be found. Apr 14 14:34:48 user devstack@n-api.service[61718]: action_args: {'id': '30643f90-4347-4b1e-b1ca-57e69e716fb4'} Apr 14 14:34:48 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 could not be found. Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 could not be found. Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:34:48 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:34:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:34:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:34:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:34:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 could not be found. Apr 14 14:34:49 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:34:49 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Returning 404 to user: Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:34:49 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f34826df-ef73-4be0-bb49-0b25c54a5ba0 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4" status: 404 len: 111 microversion: 2.1 time: 0.035337 Apr 14 14:34:49 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 287/860] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:48 2023] GET /compute/v2.1/servers/30643f90-4347-4b1e-b1ca-57e69e716fb4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] HTTP exception thrown: Instance fc7da5e7-7b87-458f-82b1-055664003a85 is not attached to volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Request method failure captured: Apr 14 14:34:49 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments/7e8ef61f-fc6b-47dc-99ad-79c2470ef08d HTTP/1.1 Apr 14 14:34:49 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:34:49 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:34:49 user devstack@n-api.service[61717]: Connection: close Apr 14 14:34:49 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:34:49 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:34:49 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:34:49 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:34:49 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWLZMRi3cUwEa6bI1hOnS_XGTRxBb_CtMVzjVWUr3T2uHfD18OBA7y4QzfiPpXtICC7nf83VythPVB150Qf30ACR2Fw4kI-RMexNK2KGmzQxQwZYTlkuTCurF4KGH6Qi9EtKxxEmkl_72paJcl2DTBesMoFTVfush8HAmP_1Ld6o2bA Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Project-Id: 51e043301622414bb492b48f0c6366a2 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestStampPattern-523457803 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51e043301622414bb492b48f0c6366a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51e043301622414bb492b48f0c6366a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51e043301622414bb492b48f0c6366a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Tenant: tempest-TestStampPattern-523457803 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Tenant-Id: 51e043301622414bb492b48f0c6366a2 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestStampPattern-523457803 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-User: tempest-TestStampPattern-523457803-project-member Apr 14 14:34:49 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:34:49 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:34:49 user devstack@n-api.service[61717]: X-User-Id: b5bccb6643e84c53ab7f1301bdf0cb97 Apr 14 14:34:49 user devstack@n-api.service[61717]: X-User-Name: tempest-TestStampPattern-523457803-project-member Apr 14 14:34:49 user devstack@n-api.service[61717]: method: > Apr 14 14:34:49 user devstack@n-api.service[61717]: exception: Instance fc7da5e7-7b87-458f-82b1-055664003a85 is not attached to volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d Apr 14 14:34:49 user devstack@n-api.service[61717]: action_args: {'server_id': 'fc7da5e7-7b87-458f-82b1-055664003a85', 'id': '7e8ef61f-fc6b-47dc-99ad-79c2470ef08d'} Apr 14 14:34:49 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d. Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7da5e7-7b87-458f-82b1-055664003a85 is not attached to volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7da5e7-7b87-458f-82b1-055664003a85 is not attached to volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d Apr 14 14:34:49 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:34:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Returning 404 to user: Instance fc7da5e7-7b87-458f-82b1-055664003a85 is not attached to volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:34:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d1c396a3-00c2-4bca-a38f-e50866e7c93d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments/7e8ef61f-fc6b-47dc-99ad-79c2470ef08d" status: 404 len: 154 microversion: 2.1 time: 0.133022 Apr 14 14:34:49 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 284/861] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:34:49 2023] DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85/os-volume_attachments/7e8ef61f-fc6b-47dc-99ad-79c2470ef08d => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Creating event network-changed:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:34:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028675 Apr 14 14:34:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 288/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:50 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:34:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85" status: 204 len: 0 microversion: 2.1 time: 0.144570 Apr 14 14:34:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 291/863] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:34:50 2023] DELETE /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:50 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:34:50 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-abf62e32-ec80-4b73-bebd-555138c52087 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85" status: 200 len: 1662 microversion: 2.1 time: 0.335275 Apr 14 14:34:50 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 285/864] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:50 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 => generated 1662 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "name": "network-vif-unplugged", "status": "completed", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Creating event network-vif-unplugged:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:34:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034140 Apr 14 14:34:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 289/865] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ddd908aa-6a0e-4e7c-8618-fdd80b887fea tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045505 Apr 14 14:34:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 292/866] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:34:51 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-25cf7aad-fe4f-4363-b11e-895e82b31da1 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044652 Apr 14 14:34:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 286/867] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:34:51 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:34:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 204 len: 0 microversion: 2.1 time: 0.131100 Apr 14 14:34:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 290/868] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:34:51 2023] DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba499ef-3621-4516-875f-492eef042874", "name": "network-vif-unplugged", "status": "completed", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:51 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:34:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Creating event network-vif-unplugged:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:34:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-882fd591-a46f-49bb-a1fb-ac31fca71b4e tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 200 len: 1659 microversion: 2.1 time: 0.460874 Apr 14 14:34:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 293/869] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:34:51 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 1659 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:34:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046627 Apr 14 14:34:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 287/870] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "name": "network-vif-plugged", "status": "completed", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}, {"server_uuid": "fc7da5e7-7b87-458f-82b1-055664003a85", "name": "network-vif-deleted", "tag": "b7a7cf30-86d8-48d3-a117-887a3bdc342b"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Creating event network-vif-plugged:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:34:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Creating event network-vif-deleted:b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance fc7da5e7-7b87-458f-82b1-055664003a85 on user Apr 14 14:34:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034291 Apr 14 14:34:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 291/871] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:54 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba499ef-3621-4516-875f-492eef042874", "name": "network-vif-plugged", "status": "completed", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:54 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Creating event network-vif-plugged:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:34:54 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032782 Apr 14 14:34:54 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 294/872] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:54 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=23 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:54 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Creating event network-changed:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:34:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040518 Apr 14 14:34:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 288/873] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:55 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba499ef-3621-4516-875f-492eef042874", "name": "network-vif-deleted", "tag": "14f10c1f-44c6-4ddb-9dcd-16205410ce60"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:55 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:55 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:34:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] Creating event network-vif-deleted:14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance cba499ef-3621-4516-875f-492eef042874 on user Apr 14 14:34:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035223 Apr 14 14:34:55 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 292/874] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:34:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-plugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:34:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:34:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:34:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:34:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Creating event network-vif-plugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:34:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028583 Apr 14 14:34:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 295/875] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:34:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-plugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Creating event network-vif-plugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:35:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050558 Apr 14 14:35:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 289/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:17 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 HTTP/1.1 Apr 14 14:35:17 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:35:17 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:35:17 user devstack@n-api.service[61718]: Connection: close Apr 14 14:35:17 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:35:17 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:35:17 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:35:17 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:35:17 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:17 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:35:17 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:35:17 user devstack@n-api.service[61718]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:17 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:17 user devstack@n-api.service[61718]: method: > Apr 14 14:35:17 user devstack@n-api.service[61718]: exception: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:17 user devstack@n-api.service[61718]: action_args: {'id': 'a30fcbc6-d8b3-42cd-8bac-fb425bb5a680'} Apr 14 14:35:17 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:17 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-acfe05f3-95ed-4ef3-a309-aeff1f2cc630 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 404 len: 111 microversion: 2.1 time: 0.037262 Apr 14 14:35:17 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 293/877] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:17 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:17 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:17 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b35205d1-7878-4265-af17-efebcbfca79a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '.version_select at 0x7f67dfd8cdc0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:17 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b35205d1-7878-4265-af17-efebcbfca79a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386274115" status: 202 len: 0 microversion: 2.1 time: 0.030499 Apr 14 14:35:17 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 296/878] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 14:35:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386274115 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:21 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 HTTP/1.1 Apr 14 14:35:21 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:35:21 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:35:21 user devstack@n-api.service[61717]: Connection: close Apr 14 14:35:21 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:35:21 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:35:21 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:35:21 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:35:21 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:21 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:35:21 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:35:21 user devstack@n-api.service[61717]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:21 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:21 user devstack@n-api.service[61717]: method: > Apr 14 14:35:21 user devstack@n-api.service[61717]: exception: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61717]: action_args: {'id': 'a30fcbc6-d8b3-42cd-8bac-fb425bb5a680'} Apr 14 14:35:21 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:21 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8517d793-4989-4ca1-ad6f-788c21906bbf tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 404 len: 111 microversion: 2.1 time: 0.047920 Apr 14 14:35:21 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 290/879] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:35:21 2023] DELETE /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:21 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 HTTP/1.1 Apr 14 14:35:21 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:35:21 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:35:21 user devstack@n-api.service[61718]: Connection: close Apr 14 14:35:21 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:35:21 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:35:21 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:35:21 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:35:21 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:21 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:35:21 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:35:21 user devstack@n-api.service[61718]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:21 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:21 user devstack@n-api.service[61718]: method: > Apr 14 14:35:21 user devstack@n-api.service[61718]: exception: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61718]: action_args: {'id': 'a30fcbc6-d8b3-42cd-8bac-fb425bb5a680'} Apr 14 14:35:21 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. Apr 14 14:35:21 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:21 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:21 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-63c977a0-3c57-4566-accc-1c51c39bbd07 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" status: 404 len: 111 microversion: 2.1 time: 0.028008 Apr 14 14:35:21 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 294/880] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:21 2023] GET /compute/v2.1/servers/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:25 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 HTTP/1.1 Apr 14 14:35:25 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:35:25 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:35:25 user devstack@n-api.service[61716]: Connection: close Apr 14 14:35:25 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:35:25 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:35:25 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:35:25 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:35:25 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61716]: method: > Apr 14 14:35:25 user devstack@n-api.service[61716]: exception: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: action_args: {'id': '4fa04501-bc13-4309-b3a2-d972e2fc7c93'} Apr 14 14:35:25 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-9e95f44e-3ee4-47b3-9ed8-1e563c4ea689 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 404 len: 111 microversion: 2.1 time: 0.038339 Apr 14 14:35:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 297/881] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:35:25 2023] DELETE /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:25 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 HTTP/1.1 Apr 14 14:35:25 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:35:25 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:35:25 user devstack@n-api.service[61717]: Connection: close Apr 14 14:35:25 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:35:25 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:35:25 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:35:25 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:35:25 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61717]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:25 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61717]: method: > Apr 14 14:35:25 user devstack@n-api.service[61717]: exception: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61717]: action_args: {'id': '4fa04501-bc13-4309-b3a2-d972e2fc7c93'} Apr 14 14:35:25 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. Apr 14 14:35:25 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-a0bc22f4-0ba4-458e-a039-b05ed59ed042 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93" status: 404 len: 111 microversion: 2.1 time: 0.041137 Apr 14 14:35:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 291/882] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:25 2023] GET /compute/v2.1/servers/4fa04501-bc13-4309-b3a2-d972e2fc7c93 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:25 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf HTTP/1.1 Apr 14 14:35:25 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:35:25 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:35:25 user devstack@n-api.service[61718]: Connection: close Apr 14 14:35:25 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:35:25 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:35:25 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:35:25 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:35:25 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61718]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:25 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61718]: method: > Apr 14 14:35:25 user devstack@n-api.service[61718]: exception: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61718]: action_args: {'id': 'd9de3e2a-3325-4bc9-bfb3-9388a620abaf'} Apr 14 14:35:25 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:25 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ae62d339-a6a6-4eee-847e-1f9e7dd94800 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 404 len: 111 microversion: 2.1 time: 0.028967 Apr 14 14:35:25 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 295/883] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:35:25 2023] DELETE /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:25 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf HTTP/1.1 Apr 14 14:35:25 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:35:25 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:35:25 user devstack@n-api.service[61716]: Connection: close Apr 14 14:35:25 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:35:25 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:35:25 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:35:25 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:35:25 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:25 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:25 user devstack@n-api.service[61716]: method: > Apr 14 14:35:25 user devstack@n-api.service[61716]: exception: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: action_args: {'id': 'd9de3e2a-3325-4bc9-bfb3-9388a620abaf'} Apr 14 14:35:25 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. Apr 14 14:35:25 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:25 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:25 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c3765638-aefc-4bf6-9450-8b4d8ffbf2c5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf" status: 404 len: 111 microversion: 2.1 time: 0.037050 Apr 14 14:35:25 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 298/884] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:25 2023] GET /compute/v2.1/servers/d9de3e2a-3325-4bc9-bfb3-9388a620abaf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d32600c6-6814-4e3d-8f5a-1aa43f9c7904 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.353665 Apr 14 14:35:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 292/885] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 14:35:25 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/os-interface => generated 282 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Creating event network-changed:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046350 Apr 14 14:35:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 296/886] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:27 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:35:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ee1c7801-246a-44c1-b89f-2b9f33933121 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1428 microversion: 2.1 time: 0.249030 Apr 14 14:35:27 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 299/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:26 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1428 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Old instance type m1.nano, new instance type m1.micro {{(pid=61717) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting quotas for user 797d2d1bff8e4b26afe7856e4c3877cf and project 3b087f26a80045f3844873220a67a4e4. Resources: {'cores', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:35:27 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:35:27 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/action" status: 202 len: 0 microversion: 2.1 time: 0.173043 Apr 14 14:35:27 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 293/888] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:35:27 2023] POST /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:27 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:35:27 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-1c616380-c092-4d2f-8cc6-873a436c026a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1437 microversion: 2.1 time: 0.158909 Apr 14 14:35:27 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 297/889] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:27 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1437 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:28 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe HTTP/1.1 Apr 14 14:35:28 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:35:28 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:35:28 user devstack@n-api.service[61716]: Connection: close Apr 14 14:35:28 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:35:28 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:35:28 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:35:28 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:35:28 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:28 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:35:28 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:35:28 user devstack@n-api.service[61716]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:28 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:28 user devstack@n-api.service[61716]: method: > Apr 14 14:35:28 user devstack@n-api.service[61716]: exception: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61716]: action_args: {'id': 'fafce4d3-18c4-4f15-af62-e599c7749efe'} Apr 14 14:35:28 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ec89f365-6fe5-485b-868a-859439c7842d tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 404 len: 111 microversion: 2.1 time: 0.034641 Apr 14 14:35:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 300/890] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:35:28 2023] DELETE /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HTTP exception thrown: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Request method failure captured: Apr 14 14:35:28 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe HTTP/1.1 Apr 14 14:35:28 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:35:28 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:35:28 user devstack@n-api.service[61717]: Connection: close Apr 14 14:35:28 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:35:28 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:35:28 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:35:28 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:35:28 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWFS6SiVG5kjhwos-8C-rY4N71Guz_fyDhvcPZt4xtv3kDfnLPxBKp2GjMxTTWtI8v88CYbICH5Gx1d3VoxIZSyOIXoKmudrp5JtZNdtqK_TwdmlzJ4PAVnj5OlOZC7b5MRzedFZtcEN8IbfcbWzoO5iso_G3YTlu3FFxrH7SxToysg Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Project-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df56fb88b961464496757a358fd15169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df56fb88b961464496757a358fd15169"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Tenant-Id: df56fb88b961464496757a358fd15169 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134968716 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:28 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:35:28 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:35:28 user devstack@n-api.service[61717]: X-User-Id: 5db83169bedc4520b5e2a2b595362ec1 Apr 14 14:35:28 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeNegativeTest-134968716-project-member Apr 14 14:35:28 user devstack@n-api.service[61717]: method: > Apr 14 14:35:28 user devstack@n-api.service[61717]: exception: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61717]: action_args: {'id': 'fafce4d3-18c4-4f15-af62-e599c7749efe'} Apr 14 14:35:28 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. Apr 14 14:35:28 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Returning 404 to user: Instance fafce4d3-18c4-4f15-af62-e599c7749efe could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1156fbbc-531a-49b8-a1fd-dd5cef47dce0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe" status: 404 len: 111 microversion: 2.1 time: 0.034499 Apr 14 14:35:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 294/891] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:28 2023] GET /compute/v2.1/servers/fafce4d3-18c4-4f15-af62-e599c7749efe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Creating event network-changed:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:35:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61718) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:35:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036339 Apr 14 14:35:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 298/892] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:30 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-unplugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:30 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Creating event network-vif-unplugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:35:30 user devstack@n-api.service[61716]: DEBUG nova.compute.api [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61716) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:35:30 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057400 Apr 14 14:35:30 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 301/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:32 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-plugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Creating event network-vif-plugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:35:32 user devstack@n-api.service[61717]: DEBUG nova.compute.api [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:35:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041115 Apr 14 14:35:32 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 295/894] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:38 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:35:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8555daeb-8168-40ba-82cf-b0e30fa5b694 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1552 microversion: 2.1 time: 0.247335 Apr 14 14:35:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 299/895] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:37 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=16 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] HTTP exception thrown: Instance fc7da5e7-7b87-458f-82b1-055664003a85 could not be found. Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Request method failure captured: Apr 14 14:35:40 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 HTTP/1.1 Apr 14 14:35:40 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:35:40 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:35:40 user devstack@n-api.service[61716]: Connection: close Apr 14 14:35:40 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:35:40 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:35:40 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:35:40 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:35:40 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWLZMRi3cUwEa6bI1hOnS_XGTRxBb_CtMVzjVWUr3T2uHfD18OBA7y4QzfiPpXtICC7nf83VythPVB150Qf30ACR2Fw4kI-RMexNK2KGmzQxQwZYTlkuTCurF4KGH6Qi9EtKxxEmkl_72paJcl2DTBesMoFTVfush8HAmP_1Ld6o2bA Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Project-Id: 51e043301622414bb492b48f0c6366a2 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestStampPattern-523457803 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51e043301622414bb492b48f0c6366a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/51e043301622414bb492b48f0c6366a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/51e043301622414bb492b48f0c6366a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Tenant: tempest-TestStampPattern-523457803 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Tenant-Id: 51e043301622414bb492b48f0c6366a2 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestStampPattern-523457803 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-User: tempest-TestStampPattern-523457803-project-member Apr 14 14:35:40 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:35:40 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:35:40 user devstack@n-api.service[61716]: X-User-Id: b5bccb6643e84c53ab7f1301bdf0cb97 Apr 14 14:35:40 user devstack@n-api.service[61716]: X-User-Name: tempest-TestStampPattern-523457803-project-member Apr 14 14:35:40 user devstack@n-api.service[61716]: method: > Apr 14 14:35:40 user devstack@n-api.service[61716]: exception: Instance fc7da5e7-7b87-458f-82b1-055664003a85 could not be found. Apr 14 14:35:40 user devstack@n-api.service[61716]: action_args: {'id': 'fc7da5e7-7b87-458f-82b1-055664003a85'} Apr 14 14:35:40 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7da5e7-7b87-458f-82b1-055664003a85 could not be found. Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7da5e7-7b87-458f-82b1-055664003a85 could not be found. Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7da5e7-7b87-458f-82b1-055664003a85 could not be found. Apr 14 14:35:40 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:40 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Returning 404 to user: Instance fc7da5e7-7b87-458f-82b1-055664003a85 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:40 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c09dca87-0f85-4361-81f4-ab394da2be9c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85" status: 404 len: 111 microversion: 2.1 time: 0.039403 Apr 14 14:35:40 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 302/896] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:40 2023] GET /compute/v2.1/servers/fc7da5e7-7b87-458f-82b1-055664003a85 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:41 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-plugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Creating event network-vif-plugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:35:41 user devstack@n-api.service[61717]: DEBUG nova.compute.api [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:35:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050620 Apr 14 14:35:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 296/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HTTP exception thrown: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Request method failure captured: Apr 14 14:35:42 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 HTTP/1.1 Apr 14 14:35:42 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:35:42 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:35:42 user devstack@n-api.service[61718]: Connection: close Apr 14 14:35:42 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:35:42 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:35:42 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:35:42 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:35:42 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWGK5qCydKE5wUJiaNcLOEEGJEg5VGRG8LjJkWcsdYx0Z33NnAf96bPckCr0dKWQCbjpT82igar-bXFQ8ktmeas0gNVkAekyAhqbsKfFILBtFDqSCoDw-MqpeAhtiZHxi4tlhGTI8zzAmTTINgBGWiTL79eApk3xGZEfffkiTIKLEzU Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Project-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Tenant-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:42 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:42 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:42 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:35:42 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:35:42 user devstack@n-api.service[61718]: X-User-Id: 303cb0475ae74f328ee503d1e9d1f652 Apr 14 14:35:42 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:42 user devstack@n-api.service[61718]: method: > Apr 14 14:35:42 user devstack@n-api.service[61718]: exception: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:42 user devstack@n-api.service[61718]: action_args: {'id': 'cba499ef-3621-4516-875f-492eef042874'} Apr 14 14:35:42 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:42 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Returning 404 to user: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-955ff7b4-a542-4bb6-8b93-d9b0eaa11194 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 404 len: 111 microversion: 2.1 time: 0.026803 Apr 14 14:35:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 300/898] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:42 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-debd3c8d-ee0d-4811-ac63-0461ebeffc7a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '.version_select at 0x7f67dff01f30>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-debd3c8d-ee0d-4811-ac63-0461ebeffc7a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-279292969" status: 202 len: 0 microversion: 2.1 time: 0.022636 Apr 14 14:35:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 303/899] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 14:35:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-279292969 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:35:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-plugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Creating event network-vif-plugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:35:43 user devstack@n-api.service[61717]: DEBUG nova.compute.api [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61717) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 14:35:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037335 Apr 14 14:35:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 297/900] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:44 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-065b60ca-03f1-4f0c-a9df-32602ee45d9b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Calling method '.version_select at 0x7f67dfda9d80>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:44 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-065b60ca-03f1-4f0c-a9df-32602ee45d9b tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-594781561" status: 202 len: 0 microversion: 2.1 time: 0.029178 Apr 14 14:35:44 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 301/901] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 14:35:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-594781561 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2038037319", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] validate_networks() for None {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Getting quotas for project e6a000f56a044c08ae1f9192a95c8f4a. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Getting quotas for user ebf7adeca29b487dba8146ad46a1ef4f and project e6a000f56a044c08ae1f9192a95c8f4a. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:35:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:35:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.524531 Apr 14 14:35:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 304/902] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:35:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:35:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d5ee99fe-687a-4995-9839-c1072955a952 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:46 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d5ee99fe-687a-4995-9839-c1072955a952 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:46 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d5ee99fe-687a-4995-9839-c1072955a952 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf7adeca29b487dba8146ad46a1ef4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a000f56a044c08ae1f9192a95c8f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:35:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d5ee99fe-687a-4995-9839-c1072955a952 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9" status: 200 len: 1209 microversion: 2.1 time: 0.089140 Apr 14 14:35:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 298/903] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:46 2023] GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:35:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:50 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:50 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=28 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Creating event network-changed:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:35:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043630 Apr 14 14:35:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 302/904] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:53 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-plugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HTTP exception thrown: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Request method failure captured: Apr 14 14:35:53 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 HTTP/1.1 Apr 14 14:35:53 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:35:53 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:35:53 user devstack@n-api.service[61716]: Connection: close Apr 14 14:35:53 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:35:53 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:35:53 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:35:53 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:35:53 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWGK5qCydKE5wUJiaNcLOEEGJEg5VGRG8LjJkWcsdYx0Z33NnAf96bPckCr0dKWQCbjpT82igar-bXFQ8ktmeas0gNVkAekyAhqbsKfFILBtFDqSCoDw-MqpeAhtiZHxi4tlhGTI8zzAmTTINgBGWiTL79eApk3xGZEfffkiTIKLEzU Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Project-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Project-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Tenant: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Tenant-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:53 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:53 user devstack@n-api.service[61716]: X-User: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:53 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:35:53 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:35:53 user devstack@n-api.service[61716]: X-User-Id: 303cb0475ae74f328ee503d1e9d1f652 Apr 14 14:35:53 user devstack@n-api.service[61716]: X-User-Name: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:53 user devstack@n-api.service[61716]: method: > Apr 14 14:35:53 user devstack@n-api.service[61716]: exception: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61716]: action_args: {'id': 'cba499ef-3621-4516-875f-492eef042874'} Apr 14 14:35:53 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Returning 404 to user: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4e6654bb-dd1d-4571-b3ed-f817d671e328 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 404 len: 111 microversion: 2.1 time: 0.035667 Apr 14 14:35:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 305/905] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:35:53 2023] DELETE /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:53 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=33 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:53 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:53 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Creating event network-vif-plugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:53 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055630 Apr 14 14:35:53 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 299/906] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HTTP exception thrown: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Request method failure captured: Apr 14 14:35:53 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 HTTP/1.1 Apr 14 14:35:53 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:35:53 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:35:53 user devstack@n-api.service[61718]: Connection: close Apr 14 14:35:53 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:35:53 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:35:53 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:35:53 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:35:53 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWGK5qCydKE5wUJiaNcLOEEGJEg5VGRG8LjJkWcsdYx0Z33NnAf96bPckCr0dKWQCbjpT82igar-bXFQ8ktmeas0gNVkAekyAhqbsKfFILBtFDqSCoDw-MqpeAhtiZHxi4tlhGTI8zzAmTTINgBGWiTL79eApk3xGZEfffkiTIKLEzU Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Project-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Tenant-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:53 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:53 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:53 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:35:53 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:35:53 user devstack@n-api.service[61718]: X-User-Id: 303cb0475ae74f328ee503d1e9d1f652 Apr 14 14:35:53 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:53 user devstack@n-api.service[61718]: method: > Apr 14 14:35:53 user devstack@n-api.service[61718]: exception: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61718]: action_args: {'id': 'cba499ef-3621-4516-875f-492eef042874'} Apr 14 14:35:53 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. Apr 14 14:35:53 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:53 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Returning 404 to user: Instance cba499ef-3621-4516-875f-492eef042874 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ef5fafaf-3047-4234-904e-98e7e39d9273 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874" status: 404 len: 111 microversion: 2.1 time: 0.048745 Apr 14 14:35:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 303/907] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:53 2023] GET /compute/v2.1/servers/cba499ef-3621-4516-875f-492eef042874 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:55 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-plugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:35:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:55 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Creating event network-vif-plugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:35:55 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037051 Apr 14 14:35:55 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 306/908] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:35:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HTTP exception thrown: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Request method failure captured: Apr 14 14:35:57 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 HTTP/1.1 Apr 14 14:35:57 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:35:57 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:35:57 user devstack@n-api.service[61717]: Connection: close Apr 14 14:35:57 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:35:57 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:35:57 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:35:57 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:35:57 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWGK5qCydKE5wUJiaNcLOEEGJEg5VGRG8LjJkWcsdYx0Z33NnAf96bPckCr0dKWQCbjpT82igar-bXFQ8ktmeas0gNVkAekyAhqbsKfFILBtFDqSCoDw-MqpeAhtiZHxi4tlhGTI8zzAmTTINgBGWiTL79eApk3xGZEfffkiTIKLEzU Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Project-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Project-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Tenant: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Tenant-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:57 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:57 user devstack@n-api.service[61717]: X-User: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:57 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:35:57 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:35:57 user devstack@n-api.service[61717]: X-User-Id: 303cb0475ae74f328ee503d1e9d1f652 Apr 14 14:35:57 user devstack@n-api.service[61717]: X-User-Name: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:57 user devstack@n-api.service[61717]: method: > Apr 14 14:35:57 user devstack@n-api.service[61717]: exception: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61717]: action_args: {'id': 'a3faeeb1-a50c-474b-b694-98c4d70435d5'} Apr 14 14:35:57 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Returning 404 to user: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:57 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7c8b9b66-61d7-44be-9c9e-6c8b2779662f tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 404 len: 111 microversion: 2.1 time: 0.036749 Apr 14 14:35:57 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 300/909] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:35:57 2023] DELETE /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:35:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HTTP exception thrown: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Request method failure captured: Apr 14 14:35:57 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 HTTP/1.1 Apr 14 14:35:57 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:35:57 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:35:57 user devstack@n-api.service[61718]: Connection: close Apr 14 14:35:57 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:35:57 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:35:57 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:35:57 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:35:57 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWGK5qCydKE5wUJiaNcLOEEGJEg5VGRG8LjJkWcsdYx0Z33NnAf96bPckCr0dKWQCbjpT82igar-bXFQ8ktmeas0gNVkAekyAhqbsKfFILBtFDqSCoDw-MqpeAhtiZHxi4tlhGTI8zzAmTTINgBGWiTL79eApk3xGZEfffkiTIKLEzU Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Project-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Project-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd9adda27714cf5b55203d8d76de05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Tenant: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Tenant-Id: 6dd9adda27714cf5b55203d8d76de05a Apr 14 14:35:57 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787222284 Apr 14 14:35:57 user devstack@n-api.service[61718]: X-User: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:57 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:35:57 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:35:57 user devstack@n-api.service[61718]: X-User-Id: 303cb0475ae74f328ee503d1e9d1f652 Apr 14 14:35:57 user devstack@n-api.service[61718]: X-User-Name: tempest-AttachVolumeTestJSON-1787222284-project-member Apr 14 14:35:57 user devstack@n-api.service[61718]: method: > Apr 14 14:35:57 user devstack@n-api.service[61718]: exception: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61718]: action_args: {'id': 'a3faeeb1-a50c-474b-b694-98c4d70435d5'} Apr 14 14:35:57 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. Apr 14 14:35:57 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:35:57 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Returning 404 to user: Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:35:57 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-3d4ece81-7efa-4b00-bbe7-7e5c6522727d tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5" status: 404 len: 111 microversion: 2.1 time: 0.035150 Apr 14 14:35:57 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 304/910] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:35:57 2023] GET /compute/v2.1/servers/a3faeeb1-a50c-474b-b694-98c4d70435d5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-352344162", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "268bc296-0903-44c4-96c7-10ea6c7be910"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] validate_networks() for [('268bc296-0903-44c4-96c7-10ea6c7be910', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting quotas for project fab35b3694734461828bb8bd19f4bc65. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting quotas for user 506ec17dec9149698ca687d2ce256acd and project fab35b3694734461828bb8bd19f4bc65. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:36:11 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:36:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.582041 Apr 14 14:36:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 307/911] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:36:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:36:11 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-f531a386-e4b7-488d-a91d-c5b75031118a tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:36:11 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-f531a386-e4b7-488d-a91d-c5b75031118a tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:36:11 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:11 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:11 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-f531a386-e4b7-488d-a91d-c5b75031118a tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:36:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-f531a386-e4b7-488d-a91d-c5b75031118a tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f" status: 200 len: 1212 microversion: 2.1 time: 0.067231 Apr 14 14:36:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 301/912] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:36:11 2023] GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f => generated 1212 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 14:36:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=5 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:15 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=5 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:15 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f2170a-239e-45bd-8864-58285cdb391f", "tag": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:15 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Creating event network-changed:f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance 88f2170a-239e-45bd-8864-58285cdb391f on user Apr 14 14:36:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034211 Apr 14 14:36:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 305/913] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:36:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:36:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2170a-239e-45bd-8864-58285cdb391f", "name": "network-vif-plugged", "status": "completed", "tag": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:17 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Creating event network-vif-plugged:f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance 88f2170a-239e-45bd-8864-58285cdb391f on user Apr 14 14:36:17 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031244 Apr 14 14:36:17 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 308/914] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:36:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:17 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:36:17 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c4e3ad71-3744-4541-a738-6b8b9893c690 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1555 microversion: 2.1 time: 0.234702 Apr 14 14:36:17 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 302/915] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:36:17 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:36:19 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2170a-239e-45bd-8864-58285cdb391f", "name": "network-vif-plugged", "status": "completed", "tag": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Creating event network-vif-plugged:f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance 88f2170a-239e-45bd-8864-58285cdb391f on user Apr 14 14:36:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048833 Apr 14 14:36:19 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 306/916] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:36:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:36 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:37 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf7adeca29b487dba8146ad46a1ef4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a000f56a044c08ae1f9192a95c8f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:36:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3fa348c2-1b16-44f1-9ee5-0fc53eb84fd5 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9" status: 200 len: 1455 microversion: 2.1 time: 0.315842 Apr 14 14:36:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 309/917] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:36:36 2023] GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9 => generated 1455 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:39 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:39 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Creating event network-changed:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:36:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044521 Apr 14 14:36:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 307/918] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:36:39 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:36:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 204 len: 0 microversion: 2.1 time: 0.142963 Apr 14 14:36:39 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 303/919] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:36:39 2023] DELETE /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:39 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:36:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1c0a337f-7c9a-4317-8a3d-c270ac3551e9 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 200 len: 1558 microversion: 2.1 time: 0.269552 Apr 14 14:36:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 310/920] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:36:39 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 1558 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:36:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-deleted", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] Creating event network-vif-deleted:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:36:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030994 Apr 14 14:36:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 308/921] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:36:41 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-unplugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}, {"server_uuid": "ca57f876-a86b-4a47-b941-ea2fd63f1298", "name": "network-vif-plugged", "status": "completed", "tag": "1219695c-8de1-4b6b-a558-b7713d98a9a9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:36:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:36:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:36:41 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:36:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Creating event network-vif-unplugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:36:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Creating event network-vif-plugged:1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance ca57f876-a86b-4a47-b941-ea2fd63f1298 on user Apr 14 14:36:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046645 Apr 14 14:36:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 304/922] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=12 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:02 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:37:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-dc061d1d-a47b-413b-b4ef-53dfdf5892c2 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f" status: 200 len: 1494 microversion: 2.1 time: 0.276099 Apr 14 14:37:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 311/923] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:37:01 2023] GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f => generated 1494 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/action" status: 204 len: 0 microversion: 2.1 time: 0.269022 Apr 14 14:37:18 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 309/924] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:37:17 2023] POST /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/action => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:18 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:37:18 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-e3c57ce9-5ee2-433d-9ce1-5b1f7153b293 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1555 microversion: 2.1 time: 0.572012 Apr 14 14:37:18 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 305/925] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:37:18 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1555 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] HTTP exception thrown: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Request method failure captured: Apr 14 14:37:29 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 HTTP/1.1 Apr 14 14:37:29 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:37:29 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:37:29 user devstack@n-api.service[61716]: Connection: close Apr 14 14:37:29 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:37:29 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:37:29 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:37:29 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:37:29 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWOYu4FVExiU4WvmTUDVOMVCxqh7uqRxn9R2OletO8JLfvAN75OWVfJro_QfcjRblYApnV--vI6L-5hgNL6wKp2ncsWTZyFpMQjLgh4Gv-_-osnawsYvFgecKEbIKfLvWAavZHPJAr7zEXKsdjfxoo13VZtjckWpAxf2YBJwRm4Tc7M Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Project-Id: 8137fbeb0b0546eb9fd19b76bb8b6b7a Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestShelveInstance-1144252643 Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8137fbeb0b0546eb9fd19b76bb8b6b7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8137fbeb0b0546eb9fd19b76bb8b6b7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8137fbeb0b0546eb9fd19b76bb8b6b7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Tenant: tempest-TestShelveInstance-1144252643 Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Tenant-Id: 8137fbeb0b0546eb9fd19b76bb8b6b7a Apr 14 14:37:29 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestShelveInstance-1144252643 Apr 14 14:37:29 user devstack@n-api.service[61716]: X-User: tempest-TestShelveInstance-1144252643-project-member Apr 14 14:37:29 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:37:29 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:37:29 user devstack@n-api.service[61716]: X-User-Id: bc2d448f2dfc45498252bab608df3446 Apr 14 14:37:29 user devstack@n-api.service[61716]: X-User-Name: tempest-TestShelveInstance-1144252643-project-member Apr 14 14:37:29 user devstack@n-api.service[61716]: method: > Apr 14 14:37:29 user devstack@n-api.service[61716]: exception: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. Apr 14 14:37:29 user devstack@n-api.service[61716]: action_args: {'id': 'ca57f876-a86b-4a47-b941-ea2fd63f1298'} Apr 14 14:37:29 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. Apr 14 14:37:29 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:37:29 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Returning 404 to user: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:37:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4575aa90-e547-4dad-8427-4ed5048cd38c tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298" status: 404 len: 111 microversion: 2.1 time: 0.034263 Apr 14 14:37:29 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 312/926] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:37:29 2023] GET /compute/v2.1/servers/ca57f876-a86b-4a47-b941-ea2fd63f1298 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:37:29 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:29 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:29 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5d1be32a-5f13-4a3a-a59a-67d86deef48d tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Calling method '.version_select at 0x7f67dfda93f0>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:37:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5d1be32a-5f13-4a3a-a59a-67d86deef48d tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-790180658" status: 202 len: 0 microversion: 2.1 time: 0.025743 Apr 14 14:37:29 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 310/927] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 14:37:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-790180658 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:37 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:37:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9" status: 204 len: 0 microversion: 2.1 time: 0.160951 Apr 14 14:37:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 306/928] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:37:37 2023] DELETE /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-unplugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:37:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Creating event network-vif-unplugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223719 Apr 14 14:37:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 311/929] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:37:38 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf7adeca29b487dba8146ad46a1ef4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a000f56a044c08ae1f9192a95c8f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:37:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-2f273d2a-103c-418d-9f02-6d7112668f5a tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9" status: 200 len: 1461 microversion: 2.1 time: 0.751709 Apr 14 14:37:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 313/930] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:37:37 2023] GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9 => generated 1461 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:37:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-deleted", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:37:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] Creating event network-vif-deleted:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092074 Apr 14 14:37:39 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 307/931] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:37:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-plugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}, {"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-plugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}, {"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-plugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}, {"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-unplugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}, {"server_uuid": "b8cf95c3-035b-461a-9b48-c485734bfca9", "name": "network-vif-plugged", "status": "completed", "tag": "33a88d60-7285-4677-a2c8-69200948dd4c"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:37:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:37:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:37:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:37:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Creating event network-vif-plugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Creating event network-vif-plugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Creating event network-vif-plugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Creating event network-vif-unplugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Creating event network-vif-plugged:33a88d60-7285-4677-a2c8-69200948dd4c for instance b8cf95c3-035b-461a-9b48-c485734bfca9 on user Apr 14 14:37:39 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034941 Apr 14 14:37:39 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 312/932] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeb4c494-9ca4-4912-83ce-e23fb572545f", "device": "/dev/vdb"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376219 Apr 14 14:38:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 314/933] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:38:02 2023] POST /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:09 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:38:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-fd19c963-8f61-4e7e-8fab-09861234dd6d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1547 microversion: 2.1 time: 1.194960 Apr 14 14:38:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 308/934] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:38:08 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1547 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:38:13 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:13 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:14 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-bd5bb6ce-4184-4382-a479-09fe674cbf82 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Action: 'create', calling method: .version_select at 0x7f67dfda8ee0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-2051732308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7cIH1GZq6di6+vECSTkynzLyyQ4iF/syoG1Wnz59qzkvk92HgogkMiVVvqKQ3/nkZ7p9Z3+4WCrJpgsbLPZHWBqsEzriBSLJeFWbatAbQlS/vMoGazryQ645/UCjugZQ=="}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:14 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-bd5bb6ce-4184-4382-a479-09fe674cbf82 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting quotas for project 10efa412c2174b31bf584dc011340328. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:38:14 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-bd5bb6ce-4184-4382-a479-09fe674cbf82 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting quotas for user aa6e905bd6cd4a3ab3c59888a5ee273e and project 10efa412c2174b31bf584dc011340328. Resources: {'key_pairs'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:38:14 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-bd5bb6ce-4184-4382-a479-09fe674cbf82 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.272538 Apr 14 14:38:14 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 313/935] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:38:13 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:15 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:15 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-339073380", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-2051732308", "security_groups": [{"name": "tempest-secgroup-smoke-1735503735"}], "networks": [{"uuid": "16b3fb2e-3da2-401b-a4ea-924cf059c727"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:15 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] validate_networks() for [('16b3fb2e-3da2-401b-a4ea-924cf059c727', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting quotas for project 10efa412c2174b31bf584dc011340328. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting quotas for user aa6e905bd6cd4a3ab3c59888a5ee273e and project 10efa412c2174b31bf584dc011340328. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:38:16 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:38:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.937967 Apr 14 14:38:16 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 315/936] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:38:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:38:16 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ce5e2f83-9f7c-4b95-96da-f78388713208 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:38:16 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ce5e2f83-9f7c-4b95-96da-f78388713208 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:16 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-ce5e2f83-9f7c-4b95-96da-f78388713208 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e905bd6cd4a3ab3c59888a5ee273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10efa412c2174b31bf584dc011340328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:38:16 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ce5e2f83-9f7c-4b95-96da-f78388713208 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c" status: 200 len: 1256 microversion: 2.1 time: 0.077287 Apr 14 14:38:16 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 309/937] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:38:16 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c => generated 1256 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:38:19 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:19 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Creating event network-changed:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:38:19 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031119 Apr 14 14:38:19 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 314/938] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:38:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:21 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-plugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Creating event network-vif-plugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:38:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038385 Apr 14 14:38:21 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 316/939] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:23 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-plugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Creating event network-vif-plugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:38:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 Apr 14 14:38:23 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 310/940] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:38:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] HTTP exception thrown: Instance b8cf95c3-035b-461a-9b48-c485734bfca9 could not be found. Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Request method failure captured: Apr 14 14:38:28 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9 HTTP/1.1 Apr 14 14:38:28 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:38:28 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:38:28 user devstack@n-api.service[61718]: Connection: close Apr 14 14:38:28 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:38:28 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:38:28 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:38:28 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:38:28 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWS_oRjvNFu_fxagDAC4vChJB0Y-F27S1iKRjCFNrPzqQrk6Q4WeA37P16x18g2reWUi4uP9A4_s9B6cp5N5EOvVXKfPNSvYu5o2l7lzPVDp8XUmgUKLf4TiYlspvv2MX_9tIgfIKBbzzGI6YtvufASGp04hSc0bxD_TyIFcrDnxHj0 Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Project-Id: e6a000f56a044c08ae1f9192a95c8f4a Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Project-Name: tempest-VolumesNegativeTest-1698798704 Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6a000f56a044c08ae1f9192a95c8f4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6a000f56a044c08ae1f9192a95c8f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6a000f56a044c08ae1f9192a95c8f4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Tenant: tempest-VolumesNegativeTest-1698798704 Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Tenant-Id: e6a000f56a044c08ae1f9192a95c8f4a Apr 14 14:38:28 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-VolumesNegativeTest-1698798704 Apr 14 14:38:28 user devstack@n-api.service[61718]: X-User: tempest-VolumesNegativeTest-1698798704-project-member Apr 14 14:38:28 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:38:28 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:38:28 user devstack@n-api.service[61718]: X-User-Id: ebf7adeca29b487dba8146ad46a1ef4f Apr 14 14:38:28 user devstack@n-api.service[61718]: X-User-Name: tempest-VolumesNegativeTest-1698798704-project-member Apr 14 14:38:28 user devstack@n-api.service[61718]: method: > Apr 14 14:38:28 user devstack@n-api.service[61718]: exception: Instance b8cf95c3-035b-461a-9b48-c485734bfca9 could not be found. Apr 14 14:38:28 user devstack@n-api.service[61718]: action_args: {'id': 'b8cf95c3-035b-461a-9b48-c485734bfca9'} Apr 14 14:38:28 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf95c3-035b-461a-9b48-c485734bfca9 could not be found. Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf95c3-035b-461a-9b48-c485734bfca9 could not be found. Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf95c3-035b-461a-9b48-c485734bfca9 could not be found. Apr 14 14:38:28 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:38:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Returning 404 to user: Instance b8cf95c3-035b-461a-9b48-c485734bfca9 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:38:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b60d60a8-72e4-42a4-a231-3b8218edb42c tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9" status: 404 len: 111 microversion: 2.1 time: 0.032397 Apr 14 14:38:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 315/941] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:38:28 2023] GET /compute/v2.1/servers/b8cf95c3-035b-461a-9b48-c485734bfca9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:39 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'services' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:38:39 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f/os-volume_attachments/eeb4c494-9ca4-4912-83ce-e23fb572545f" status: 202 len: 0 microversion: 2.1 time: 0.254357 Apr 14 14:38:39 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 317/942] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:38:39 2023] DELETE /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f/os-volume_attachments/eeb4c494-9ca4-4912-83ce-e23fb572545f => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:39 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:38:39 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f" status: 204 len: 0 microversion: 2.1 time: 0.164655 Apr 14 14:38:39 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 311/943] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:38:39 2023] DELETE /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:39 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:40 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:38:40 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-076e887d-64ee-4ddb-ad6b-e552f7c2997d tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f" status: 200 len: 1546 microversion: 2.1 time: 0.543083 Apr 14 14:38:40 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 316/944] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:38:39 2023] GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f => generated 1546 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:38:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2170a-239e-45bd-8864-58285cdb391f", "name": "network-vif-unplugged", "status": "completed", "tag": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:41 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Creating event network-vif-unplugged:f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance 88f2170a-239e-45bd-8864-58285cdb391f on user Apr 14 14:38:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037530 Apr 14 14:38:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 318/945] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2170a-239e-45bd-8864-58285cdb391f", "name": "network-vif-deleted", "tag": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] Creating event network-vif-deleted:f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance 88f2170a-239e-45bd-8864-58285cdb391f on user Apr 14 14:38:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033102 Apr 14 14:38:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 312/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:38:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f2170a-239e-45bd-8864-58285cdb391f", "name": "network-vif-plugged", "status": "completed", "tag": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:38:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:38:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:38:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:38:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Creating event network-vif-plugged:f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance 88f2170a-239e-45bd-8864-58285cdb391f on user Apr 14 14:38:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Apr 14 14:38:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 317/947] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:06 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:07 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e905bd6cd4a3ab3c59888a5ee273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10efa412c2174b31bf584dc011340328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:39:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e0a0e3ea-241a-4090-aee2-a42dcc99a72f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c" status: 200 len: 1568 microversion: 2.1 time: 0.268369 Apr 14 14:39:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 319/948] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:39:06 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:10 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:39:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-81db3ae0-d8b9-4b9a-adf2-921ed1e306be tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1547 microversion: 2.1 time: 0.510569 Apr 14 14:39:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 313/949] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:39:10 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1547 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/action" status: 200 len: 28257 microversion: 2.1 time: 0.290237 Apr 14 14:39:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 318/950] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:39:10 2023] POST /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a/action => generated 28257 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:11 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:39:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b8a5fa98-8f51-4a72-aff7-5a5ae6adc6bf tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577" status: 200 len: 1540 microversion: 2.1 time: 0.213787 Apr 14 14:39:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 320/951] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:39:10 2023] GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 => generated 1540 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] HTTP exception thrown: Instance 88f2170a-239e-45bd-8864-58285cdb391f could not be found. Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Request method failure captured: Apr 14 14:39:30 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f HTTP/1.1 Apr 14 14:39:30 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:39:30 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:39:30 user devstack@n-api.service[61717]: Connection: close Apr 14 14:39:30 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:39:30 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:39:30 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:39:30 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:39:30 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWTUxTDXGxtuyFe1Bn6MHysJBuWNhMTTIztgD9F-8CHAazFXRkX5f5-8X6zVm72k-R22vwys2oHfrrBa-jMgEvNoHp8nl_rnm3eD9IfrmGLMlC18hCjM-tjNq4iNdr-RxaMUpxwKCHhqz_7xCW91g3tTKaK6MH6ad8j0ruxz50vMn3s Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Project-Id: fab35b3694734461828bb8bd19f4bc65 Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1438289684 Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fab35b3694734461828bb8bd19f4bc65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fab35b3694734461828bb8bd19f4bc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fab35b3694734461828bb8bd19f4bc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Tenant: tempest-VolumesSnapshotTestJSON-1438289684 Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Tenant-Id: fab35b3694734461828bb8bd19f4bc65 Apr 14 14:39:30 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1438289684 Apr 14 14:39:30 user devstack@n-api.service[61717]: X-User: tempest-VolumesSnapshotTestJSON-1438289684-project-member Apr 14 14:39:30 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:39:30 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:39:30 user devstack@n-api.service[61717]: X-User-Id: 506ec17dec9149698ca687d2ce256acd Apr 14 14:39:30 user devstack@n-api.service[61717]: X-User-Name: tempest-VolumesSnapshotTestJSON-1438289684-project-member Apr 14 14:39:30 user devstack@n-api.service[61717]: method: > Apr 14 14:39:30 user devstack@n-api.service[61717]: exception: Instance 88f2170a-239e-45bd-8864-58285cdb391f could not be found. Apr 14 14:39:30 user devstack@n-api.service[61717]: action_args: {'id': '88f2170a-239e-45bd-8864-58285cdb391f'} Apr 14 14:39:30 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f2170a-239e-45bd-8864-58285cdb391f could not be found. Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f2170a-239e-45bd-8864-58285cdb391f could not be found. Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f2170a-239e-45bd-8864-58285cdb391f could not be found. Apr 14 14:39:30 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:39:30 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Returning 404 to user: Instance 88f2170a-239e-45bd-8864-58285cdb391f could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:39:30 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-538a391a-570d-4ee6-ae6a-3a047d07ef48 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f" status: 404 len: 111 microversion: 2.1 time: 0.036690 Apr 14 14:39:30 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 314/952] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:39:30 2023] GET /compute/v2.1/servers/88f2170a-239e-45bd-8864-58285cdb391f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:39:44 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-404552932", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "268bc296-0903-44c4-96c7-10ea6c7be910"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:39:44 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:44 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:44 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] validate_networks() for [('268bc296-0903-44c4-96c7-10ea6c7be910', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting quotas for project fab35b3694734461828bb8bd19f4bc65. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting quotas for user 506ec17dec9149698ca687d2ce256acd and project fab35b3694734461828bb8bd19f4bc65. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:39:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:39:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.961915 Apr 14 14:39:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 319/953] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:39:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:39:45 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-a16d43e1-e15c-4192-aea5-1c70da0eadf8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:39:45 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-a16d43e1-e15c-4192-aea5-1c70da0eadf8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:39:45 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:45 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=12 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:45 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-a16d43e1-e15c-4192-aea5-1c70da0eadf8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:39:45 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-a16d43e1-e15c-4192-aea5-1c70da0eadf8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1" status: 200 len: 1212 microversion: 2.1 time: 0.074835 Apr 14 14:39:45 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 321/954] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:39:45 2023] GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1 => generated 1212 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:39:48 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6952658d-8c9d-4359-9f90-04a35e6126a1", "tag": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:39:48 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:48 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:39:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:48 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Creating event network-changed:3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 on user Apr 14 14:39:48 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Apr 14 14:39:48 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 315/955] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:39:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952658d-8c9d-4359-9f90-04a35e6126a1", "name": "network-vif-plugged", "status": "completed", "tag": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:39:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Creating event network-vif-plugged:3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 on user Apr 14 14:39:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058697 Apr 14 14:39:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 320/956] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:39:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952658d-8c9d-4359-9f90-04a35e6126a1", "name": "network-vif-plugged", "status": "completed", "tag": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:39:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:39:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:39:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:39:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Creating event network-vif-plugged:3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 on user Apr 14 14:39:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 Apr 14 14:39:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 322/957] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:07 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e905bd6cd4a3ab3c59888a5ee273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10efa412c2174b31bf584dc011340328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:40:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c3934a17-e3bc-43cd-ab31-c8d076527cbb tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c" status: 200 len: 1568 microversion: 2.1 time: 0.233469 Apr 14 14:40:07 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 316/958] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:40:07 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:40:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 204 len: 0 microversion: 2.1 time: 0.142992 Apr 14 14:40:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 321/959] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:40:11 2023] DELETE /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:11 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-unplugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:40:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:11 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Creating event network-vif-unplugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:40:11 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:40:11 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035353 Apr 14 14:40:11 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 317/960] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:40:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:40:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-e6669402-f073-4b5a-a5b7-72af2012a2c2 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 200 len: 1553 microversion: 2.1 time: 0.446633 Apr 14 14:40:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 323/961] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:40:11 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 1553 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Creating event network-changed:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:40:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034697 Apr 14 14:40:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 322/962] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:40:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:40:12 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1f13c70-6029-4595-b745-31a56b177e54"}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:40:12 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:13 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:13 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300801 Apr 14 14:40:13 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 318/963] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:40:12 2023] POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:40:13 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-plugged", "status": "completed", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}, {"server_uuid": "6d350d39-ba90-4e7f-8f95-bf565f787b0a", "name": "network-vif-deleted", "tag": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:40:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:13 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Creating event network-vif-plugged:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:40:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Creating event network-vif-deleted:749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a on user Apr 14 14:40:13 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032404 Apr 14 14:40:13 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 324/964] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:40:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:32 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'services' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:40:32 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/d1f13c70-6029-4595-b745-31a56b177e54" status: 202 len: 0 microversion: 2.1 time: 0.305811 Apr 14 14:40:32 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 323/965] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:40:32 2023] DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/d1f13c70-6029-4595-b745-31a56b177e54 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0713e971-689b-4c09-ba4e-f6202b51ece0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Apr 14 14:40:32 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 319/966] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:40:32 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:40:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:40:36 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:40:36 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-90e0ccf5-2d2c-4931-853d-09c57d115bc8 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1" status: 200 len: 1494 microversion: 2.1 time: 0.345531 Apr 14 14:40:36 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 325/967] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:40:35 2023] GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1 => generated 1494 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:41:01 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a HTTP/1.1 Apr 14 14:41:01 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:41:01 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:41:01 user devstack@n-api.service[61718]: Connection: close Apr 14 14:41:01 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:41:01 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:41:01 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:41:01 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:41:01 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:01 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61718]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:01 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:41:01 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:41:01 user devstack@n-api.service[61718]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:41:01 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:01 user devstack@n-api.service[61718]: method: > Apr 14 14:41:01 user devstack@n-api.service[61718]: exception: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61718]: action_args: {'id': '6d350d39-ba90-4e7f-8f95-bf565f787b0a'} Apr 14 14:41:01 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:41:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-109aa2ea-9416-4710-8fcf-326415f80b09 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 404 len: 111 microversion: 2.1 time: 0.048319 Apr 14 14:41:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 324/968] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:41:01 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:41:01 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a HTTP/1.1 Apr 14 14:41:01 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:41:01 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:41:01 user devstack@n-api.service[61717]: Connection: close Apr 14 14:41:01 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:41:01 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:41:01 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:41:01 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:41:01 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:01 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61717]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:01 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:41:01 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:41:01 user devstack@n-api.service[61717]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:41:01 user devstack@n-api.service[61717]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:01 user devstack@n-api.service[61717]: method: > Apr 14 14:41:01 user devstack@n-api.service[61717]: exception: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61717]: action_args: {'id': '6d350d39-ba90-4e7f-8f95-bf565f787b0a'} Apr 14 14:41:01 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:41:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-356e1f2e-f399-4d3d-921b-4b2ffdc1d1c5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 404 len: 111 microversion: 2.1 time: 0.032024 Apr 14 14:41:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 320/969] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:41:01 2023] DELETE /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:41:01 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a HTTP/1.1 Apr 14 14:41:01 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:41:01 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:41:01 user devstack@n-api.service[61716]: Connection: close Apr 14 14:41:01 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:41:01 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:41:01 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:41:01 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:41:01 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:01 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:01 user devstack@n-api.service[61716]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:01 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:41:01 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:41:01 user devstack@n-api.service[61716]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:41:01 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:01 user devstack@n-api.service[61716]: method: > Apr 14 14:41:01 user devstack@n-api.service[61716]: exception: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61716]: action_args: {'id': '6d350d39-ba90-4e7f-8f95-bf565f787b0a'} Apr 14 14:41:01 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. Apr 14 14:41:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:41:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ec0be718-f565-4889-8d29-d67659cb8f9b tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a" status: 404 len: 111 microversion: 2.1 time: 0.031488 Apr 14 14:41:01 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 326/970] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:41:01 2023] GET /compute/v2.1/servers/6d350d39-ba90-4e7f-8f95-bf565f787b0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:02 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:41:02 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577" status: 204 len: 0 microversion: 2.1 time: 0.123731 Apr 14 14:41:02 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 325/971] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:41:01 2023] DELETE /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:02 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:41:02 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-979f66c4-d864-4822-8698-03039ff588ca tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577" status: 200 len: 1546 microversion: 2.1 time: 0.311974 Apr 14 14:41:02 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 321/972] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:41:02 2023] GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 => generated 1546 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:41:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "name": "network-vif-unplugged", "status": "completed", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:41:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Creating event network-vif-unplugged:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:41:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197291 Apr 14 14:41:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 327/973] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:41:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "name": "network-vif-deleted", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:41:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] Creating event network-vif-deleted:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:41:03 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033157 Apr 14 14:41:03 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 326/974] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:41:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:41:04 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dc94a3-6933-475b-8803-828acc9d6577", "name": "network-vif-plugged", "status": "completed", "tag": "a7f26438-6282-4bdb-a730-cddb218c10ce"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:41:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Creating event network-vif-plugged:a7f26438-6282-4bdb-a730-cddb218c10ce for instance 48dc94a3-6933-475b-8803-828acc9d6577 on user Apr 14 14:41:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047406 Apr 14 14:41:04 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 322/975] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:41:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:22 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:23 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-36dc6c2b-78da-46af-8342-d70e82edc4a8 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046785 Apr 14 14:41:23 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 328/976] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:41:22 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7da4ec7-6705-4f91-8c95-a082e8cc989b"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270743 Apr 14 14:41:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 327/977] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:41:26 2023] POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=16 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:35 user devstack@n-api.service[61717]: DEBUG nova.objects.instance [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'services' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=61717) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:41:35 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/a7da4ec7-6705-4f91-8c95-a082e8cc989b" status: 202 len: 0 microversion: 2.1 time: 0.271494 Apr 14 14:41:35 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 323/978] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:41:34 2023] DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/a7da4ec7-6705-4f91-8c95-a082e8cc989b => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:35 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-96ba7403-b7ef-4126-8ce7-6a1b0975378f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065330 Apr 14 14:41:35 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 329/979] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:41:35 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58650e08-b3bf-4fad-ba96-366d6bb19f6f", "device": "/dev/vdb"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724100 Apr 14 14:41:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 328/980] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:41:36 2023] POST /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:41:52 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 HTTP/1.1 Apr 14 14:41:52 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:41:52 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:41:52 user devstack@n-api.service[61717]: Connection: close Apr 14 14:41:52 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:41:52 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:41:52 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:41:52 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:41:52 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:52 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:52 user devstack@n-api.service[61717]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:52 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:41:52 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:41:52 user devstack@n-api.service[61717]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:41:52 user devstack@n-api.service[61717]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:52 user devstack@n-api.service[61717]: method: > Apr 14 14:41:52 user devstack@n-api.service[61717]: exception: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. Apr 14 14:41:52 user devstack@n-api.service[61717]: action_args: {'id': '48dc94a3-6933-475b-8803-828acc9d6577'} Apr 14 14:41:52 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. Apr 14 14:41:52 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:41:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:41:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7e12299b-c1ea-473d-9286-de66c3b99dc1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577" status: 404 len: 111 microversion: 2.1 time: 0.033755 Apr 14 14:41:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 324/981] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:41:52 2023] GET /compute/v2.1/servers/48dc94a3-6933-475b-8803-828acc9d6577 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:41:59 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e HTTP/1.1 Apr 14 14:41:59 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:41:59 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:41:59 user devstack@n-api.service[61716]: Connection: close Apr 14 14:41:59 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:41:59 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:41:59 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:41:59 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:41:59 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:59 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:59 user devstack@n-api.service[61716]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:59 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:41:59 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:41:59 user devstack@n-api.service[61716]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:41:59 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:59 user devstack@n-api.service[61716]: method: > Apr 14 14:41:59 user devstack@n-api.service[61716]: exception: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61716]: action_args: {'id': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'} Apr 14 14:41:59 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:41:59 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8534b04f-5eac-429d-9383-cabc63b937f7 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 404 len: 111 microversion: 2.1 time: 0.033582 Apr 14 14:41:59 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 330/982] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:41:59 2023] DELETE /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:41:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HTTP exception thrown: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Request method failure captured: Apr 14 14:41:59 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e HTTP/1.1 Apr 14 14:41:59 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:41:59 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:41:59 user devstack@n-api.service[61718]: Connection: close Apr 14 14:41:59 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:41:59 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:41:59 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:41:59 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:41:59 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWBbnNWjUCf3LXKUcu4OV3jhTSsnpuTkpFKl4A-KZnOua-DGMCFkHSWY1zgKyj_0RbVGgu_MMvBRJeGHrSZv8uwjs50pBq70RcH1dDLsWJTa0sBr3fSCShAJRASlUAQ7BA8R-AvncTyvC06f89v5cKZ4KEDhYdvnrLLxGmVnbB085lE Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Project-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b087f26a80045f3844873220a67a4e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Tenant-Id: 3b087f26a80045f3844873220a67a4e4 Apr 14 14:41:59 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerActionsTestJSON-932644409 Apr 14 14:41:59 user devstack@n-api.service[61718]: X-User: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:59 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:41:59 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:41:59 user devstack@n-api.service[61718]: X-User-Id: 797d2d1bff8e4b26afe7856e4c3877cf Apr 14 14:41:59 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerActionsTestJSON-932644409-project-member Apr 14 14:41:59 user devstack@n-api.service[61718]: method: > Apr 14 14:41:59 user devstack@n-api.service[61718]: exception: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61718]: action_args: {'id': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'} Apr 14 14:41:59 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. Apr 14 14:41:59 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:41:59 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Returning 404 to user: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:41:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-26c8416f-830f-405b-b7e0-c9d1d8b94832 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" status: 404 len: 111 microversion: 2.1 time: 0.038009 Apr 14 14:41:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 329/983] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:41:59 2023] GET /compute/v2.1/servers/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:41:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5c0c5a91-d0cb-4cce-a1a9-0736c9b8a064 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Calling method '.version_select at 0x7f67e43327a0>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:41:59 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5c0c5a91-d0cb-4cce-a1a9-0736c9b8a064 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220938053" status: 202 len: 0 microversion: 2.1 time: 0.028909 Apr 14 14:41:59 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 325/984] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 14:41:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220938053 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:01 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'services' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:42:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1/os-volume_attachments/58650e08-b3bf-4fad-ba96-366d6bb19f6f" status: 202 len: 0 microversion: 2.1 time: 0.167559 Apr 14 14:42:01 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 331/985] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:42:01 2023] DELETE /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1/os-volume_attachments/58650e08-b3bf-4fad-ba96-366d6bb19f6f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:42:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1" status: 204 len: 0 microversion: 2.1 time: 0.131344 Apr 14 14:42:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 330/986] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:42:01 2023] DELETE /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:01 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:42:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-1bee6682-eb62-43ae-86c5-a220a24762fb tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1" status: 200 len: 1546 microversion: 2.1 time: 0.407773 Apr 14 14:42:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 326/987] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:42:01 2023] GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1 => generated 1546 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:42:03 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952658d-8c9d-4359-9f90-04a35e6126a1", "name": "network-vif-unplugged", "status": "completed", "tag": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Creating event network-vif-unplugged:3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 on user Apr 14 14:42:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033998 Apr 14 14:42:03 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 332/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:42:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:04 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952658d-8c9d-4359-9f90-04a35e6126a1", "name": "network-vif-deleted", "tag": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:04 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:04 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] Creating event network-vif-deleted:3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 on user Apr 14 14:42:04 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034578 Apr 14 14:42:04 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 331/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:05 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952658d-8c9d-4359-9f90-04a35e6126a1", "name": "network-vif-plugged", "status": "completed", "tag": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:05 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Creating event network-vif-plugged:3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 on user Apr 14 14:42:05 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029520 Apr 14 14:42:05 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 327/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-682419594", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "8257c570-6815-4a7d-b7f5-dfb76e8c0263"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:10 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] validate_networks() for [('8257c570-6815-4a7d-b7f5-dfb76e8c0263', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for user 2e321f85d3d44c2baf210a1962f4f08f and project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:42:11 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:42:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.723607 Apr 14 14:42:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 333/991] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:42:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:42:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-3b04fa2d-bbe0-4de0-b4ab-d3aa7a453e77 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:11 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-3b04fa2d-bbe0-4de0-b4ab-d3aa7a453e77 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:11 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-3b04fa2d-bbe0-4de0-b4ab-d3aa7a453e77 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:42:11 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-3b04fa2d-bbe0-4de0-b4ab-d3aa7a453e77 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:42:11 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-3b04fa2d-bbe0-4de0-b4ab-d3aa7a453e77 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:42:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-3b04fa2d-bbe0-4de0-b4ab-d3aa7a453e77 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b" status: 200 len: 1394 microversion: 2.87 time: 0.081834 Apr 14 14:42:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 332/992] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:42:11 2023] GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b => generated 1394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:42:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf7382e-7ffd-4f89-8b79-e8616462c61b", "tag": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Creating event network-changed:3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b on user Apr 14 14:42:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031499 Apr 14 14:42:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 328/993] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:42:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:16 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf7382e-7ffd-4f89-8b79-e8616462c61b", "name": "network-vif-plugged", "status": "completed", "tag": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Creating event network-vif-plugged:3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b on user Apr 14 14:42:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Apr 14 14:42:16 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 334/994] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:42:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:18 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf7382e-7ffd-4f89-8b79-e8616462c61b", "name": "network-vif-plugged", "status": "completed", "tag": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:18 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Creating event network-vif-plugged:3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b on user Apr 14 14:42:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054570 Apr 14 14:42:18 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 333/995] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=12 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7beb3afb-eb33-4cf7-ae95-bd198f664b53 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050341 Apr 14 14:42:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 329/996] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:42:25 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:42:28 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:28 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:28 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:28 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7aea457-6857-44f9-a3bf-0a76f58ba06e"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:42:28 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324785 Apr 14 14:42:29 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 335/997] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:42:28 2023] POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:37 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'services' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:42:37 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/f7aea457-6857-44f9-a3bf-0a76f58ba06e" status: 202 len: 0 microversion: 2.1 time: 0.194498 Apr 14 14:42:37 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 334/998] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:42:37 2023] DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/f7aea457-6857-44f9-a3bf-0a76f58ba06e => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:37 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:37 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0781100d-31de-4ded-bee7-c828fcd6854b tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058665 Apr 14 14:42:37 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 330/999] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:42:37 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:42:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] HTTP exception thrown: Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 could not be found. Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Request method failure captured: Apr 14 14:42:51 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1 HTTP/1.1 Apr 14 14:42:51 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:42:51 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:42:51 user devstack@n-api.service[61716]: Connection: close Apr 14 14:42:51 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:42:51 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:42:51 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:42:51 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:42:51 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWTUxTDXGxtuyFe1Bn6MHysJBuWNhMTTIztgD9F-8CHAazFXRkX5f5-8X6zVm72k-R22vwys2oHfrrBa-jMgEvNoHp8nl_rnm3eD9IfrmGLMlC18hCjM-tjNq4iNdr-RxaMUpxwKCHhqz_7xCW91g3tTKaK6MH6ad8j0ruxz50vMn3s Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Project-Id: fab35b3694734461828bb8bd19f4bc65 Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1438289684 Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fab35b3694734461828bb8bd19f4bc65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fab35b3694734461828bb8bd19f4bc65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fab35b3694734461828bb8bd19f4bc65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Tenant: tempest-VolumesSnapshotTestJSON-1438289684 Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Tenant-Id: fab35b3694734461828bb8bd19f4bc65 Apr 14 14:42:51 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1438289684 Apr 14 14:42:51 user devstack@n-api.service[61716]: X-User: tempest-VolumesSnapshotTestJSON-1438289684-project-member Apr 14 14:42:51 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:42:51 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:42:51 user devstack@n-api.service[61716]: X-User-Id: 506ec17dec9149698ca687d2ce256acd Apr 14 14:42:51 user devstack@n-api.service[61716]: X-User-Name: tempest-VolumesSnapshotTestJSON-1438289684-project-member Apr 14 14:42:51 user devstack@n-api.service[61716]: method: > Apr 14 14:42:51 user devstack@n-api.service[61716]: exception: Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 could not be found. Apr 14 14:42:51 user devstack@n-api.service[61716]: action_args: {'id': '6952658d-8c9d-4359-9f90-04a35e6126a1'} Apr 14 14:42:51 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 could not be found. Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 could not be found. Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 could not be found. Apr 14 14:42:51 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:42:51 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Returning 404 to user: Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:42:51 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-ee388eb7-be5e-4560-9cba-c0efe7c94eb3 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1" status: 404 len: 111 microversion: 2.1 time: 0.033399 Apr 14 14:42:51 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 336/1000] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:42:51 2023] GET /compute/v2.1/servers/6952658d-8c9d-4359-9f90-04a35e6126a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:43:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:43:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-74800b17-7e8f-4007-a1f7-7be48234c0bc tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b" status: 200 len: 1689 microversion: 2.87 time: 0.321523 Apr 14 14:43:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 335/1001] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:43:01 2023] GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b => generated 1689 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:43:27 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:27 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-ee2a0768-6f24-4a96-ac4e-41aaef177dbc tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158020 Apr 14 14:43:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 331/1002] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:43:27 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f6fe76-390b-42d8-bf92-7b5c4768515b"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382188 Apr 14 14:43:34 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 337/1003] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 14:43:33 2023] POST /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:45 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'services' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:43:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/73f6fe76-390b-42d8-bf92-7b5c4768515b" status: 202 len: 0 microversion: 2.1 time: 0.273073 Apr 14 14:43:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 336/1004] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 14:43:45 2023] DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments/73f6fe76-390b-42d8-bf92-7b5c4768515b => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:43:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:43:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-02a1f6bc-f078-4323-9466-aa0cf2d51671 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047732 Apr 14 14:43:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 332/1005] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:43:45 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-306738564"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b/action" status: 202 len: 52 microversion: 2.87 time: 0.912648 Apr 14 14:44:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 338/1006] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:44:02 2023] POST /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b/action => generated 52 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:44:08 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:44:08 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-90e1f4da-639c-489f-a3b9-17313b8567d4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b" status: 200 len: 1689 microversion: 2.87 time: 0.599630 Apr 14 14:44:08 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 337/1007] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:44:08 2023] GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b => generated 1689 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:44:18 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1057433537", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "058b21a0-7ad7-4dc9-ac26-a3d07b607152", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6a61e399-feba-4459-a235-1ed131fcfcb1"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:44:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:18 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:18 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] validate_networks() for [('6a61e399-feba-4459-a235-1ed131fcfcb1', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:44:19 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='058b21a0-7ad7-4dc9-ac26-a3d07b607152',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:44:19 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.098073 Apr 14 14:44:19 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 333/1008] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:44:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:44:19 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:19 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:19 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-244eba3e-83ef-4290-a3df-cd8aada4c280 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:44:19 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-244eba3e-83ef-4290-a3df-cd8aada4c280 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:44:19 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-244eba3e-83ef-4290-a3df-cd8aada4c280 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:44:19 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-244eba3e-83ef-4290-a3df-cd8aada4c280 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 200 len: 1052 microversion: 2.1 time: 0.075079 Apr 14 14:44:19 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 339/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:44:19 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 1052 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:44:22 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:22 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:22 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d4aa8c-3e3b-4988-9876-1538edd88744", "tag": "27658df0-382a-404b-afde-a2f3f50eeeb2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:44:22 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:22 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:22 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:22 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Creating event network-changed:27658df0-382a-404b-afde-a2f3f50eeeb2 for instance 26d4aa8c-3e3b-4988-9876-1538edd88744 on user Apr 14 14:44:22 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112752 Apr 14 14:44:22 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 338/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:44:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d4aa8c-3e3b-4988-9876-1538edd88744", "name": "network-vif-plugged", "status": "completed", "tag": "27658df0-382a-404b-afde-a2f3f50eeeb2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Creating event network-vif-plugged:27658df0-382a-404b-afde-a2f3f50eeeb2 for instance 26d4aa8c-3e3b-4988-9876-1538edd88744 on user Apr 14 14:44:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043984 Apr 14 14:44:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 334/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:35 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:35 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-70f97f28-88a7-4ed1-8a74-ce07afebeb4d tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078819 Apr 14 14:44:36 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 340/1012] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 14:44:35 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 14:44:36 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:36 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:36 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d4aa8c-3e3b-4988-9876-1538edd88744", "name": "network-vif-plugged", "status": "completed", "tag": "27658df0-382a-404b-afde-a2f3f50eeeb2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:44:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:36 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Creating event network-vif-plugged:27658df0-382a-404b-afde-a2f3f50eeeb2 for instance 26d4aa8c-3e3b-4988-9876-1538edd88744 on user Apr 14 14:44:36 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063459 Apr 14 14:44:36 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 339/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:44:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:44:56 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:56 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:44:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Creating event network-changed:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:44:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038694 Apr 14 14:44:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 335/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:44:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:44:59 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:45:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c" status: 204 len: 0 microversion: 2.1 time: 0.141059 Apr 14 14:45:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 341/1015] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:44:59 2023] DELETE /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-unplugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Creating event network-vif-unplugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044705 Apr 14 14:45:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 336/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:45:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:45:00 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e905bd6cd4a3ab3c59888a5ee273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10efa412c2174b31bf584dc011340328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:45:00 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-bedd9e84-79d4-4831-bfb2-c95f6c012941 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c" status: 200 len: 1574 microversion: 2.1 time: 0.343168 Apr 14 14:45:00 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 340/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:45:00 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c => generated 1574 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:45:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-plugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}, {"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-plugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}, {"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-plugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}, {"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-unplugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Creating event network-vif-plugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Creating event network-vif-plugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Creating event network-vif-plugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Creating event network-vif-unplugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.030171 Apr 14 14:45:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 342/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:45:02 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:45:04 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-plugged", "status": "completed", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}, {"server_uuid": "47e05edc-4808-49de-b882-addd28b2258c", "name": "network-vif-deleted", "tag": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:04 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Creating event network-vif-plugged:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Creating event network-vif-deleted:7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance 47e05edc-4808-49de-b882-addd28b2258c on user Apr 14 14:45:04 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029627 Apr 14 14:45:04 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 337/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:45:08 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-437168363", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "8257c570-6815-4a7d-b7f5-dfb76e8c0263"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:08 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] validate_networks() for [('8257c570-6815-4a7d-b7f5-dfb76e8c0263', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for user 2e321f85d3d44c2baf210a1962f4f08f and project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:45:09 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:45:09 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.727571 Apr 14 14:45:09 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 341/1020] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:45:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:45:09 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-86eca233-31d6-4cad-b2f6-5dde5f51ecb0 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:45:09 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-86eca233-31d6-4cad-b2f6-5dde5f51ecb0 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:45:09 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-86eca233-31d6-4cad-b2f6-5dde5f51ecb0 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:45:09 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-86eca233-31d6-4cad-b2f6-5dde5f51ecb0 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:45:09 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-86eca233-31d6-4cad-b2f6-5dde5f51ecb0 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:09 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-86eca233-31d6-4cad-b2f6-5dde5f51ecb0 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1394 microversion: 2.87 time: 0.078181 Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:09 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 343/1021] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:45:09 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1394 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:09 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:45:09 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d98160a0-be80-4346-9ff0-4418df1c53b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 200 len: 1379 microversion: 2.1 time: 0.240083 Apr 14 14:45:09 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 338/1022] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:45:09 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 1379 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:45:11 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:11 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Creating event network-changed:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:45:11 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042470 Apr 14 14:45:11 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 342/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:45:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039429 Apr 14 14:45:24 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 344/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:45:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:45:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=12 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:45:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047962 Apr 14 14:45:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 339/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:45:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=10 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] HTTP exception thrown: Instance 47e05edc-4808-49de-b882-addd28b2258c could not be found. Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Request method failure captured: Apr 14 14:45:50 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c HTTP/1.1 Apr 14 14:45:50 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:45:50 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:45:50 user devstack@n-api.service[61718]: Connection: close Apr 14 14:45:50 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:45:50 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:45:50 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:45:50 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:45:50 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWVOclrv2HU4NCjSZq_NCSRLrCk_JIu2SP7Jh36WMuEvj_W0BvSp0VXzDl4sq81gSV5oLvhr8v-wVymCJbB2Dx6vW5rpGUOHqcWOfHgo4Vv6mGTK84e-DZQ4TgKFus6ImCuM8RgMV3DgWYNId_IQtpZCLfVe4vF2werR9zb1PbC9AoU Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Project-Id: 10efa412c2174b31bf584dc011340328 Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1043128591 Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10efa412c2174b31bf584dc011340328"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10efa412c2174b31bf584dc011340328"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/10efa412c2174b31bf584dc011340328"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Tenant: tempest-SnapshotDataIntegrityTests-1043128591 Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Tenant-Id: 10efa412c2174b31bf584dc011340328 Apr 14 14:45:50 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1043128591 Apr 14 14:45:50 user devstack@n-api.service[61718]: X-User: tempest-SnapshotDataIntegrityTests-1043128591-project-member Apr 14 14:45:50 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:45:50 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:45:50 user devstack@n-api.service[61718]: X-User-Id: aa6e905bd6cd4a3ab3c59888a5ee273e Apr 14 14:45:50 user devstack@n-api.service[61718]: X-User-Name: tempest-SnapshotDataIntegrityTests-1043128591-project-member Apr 14 14:45:50 user devstack@n-api.service[61718]: method: > Apr 14 14:45:50 user devstack@n-api.service[61718]: exception: Instance 47e05edc-4808-49de-b882-addd28b2258c could not be found. Apr 14 14:45:50 user devstack@n-api.service[61718]: action_args: {'id': '47e05edc-4808-49de-b882-addd28b2258c'} Apr 14 14:45:50 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e05edc-4808-49de-b882-addd28b2258c could not be found. Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e05edc-4808-49de-b882-addd28b2258c could not be found. Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e05edc-4808-49de-b882-addd28b2258c could not be found. Apr 14 14:45:50 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:45:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Returning 404 to user: Instance 47e05edc-4808-49de-b882-addd28b2258c could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:45:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2ded8eca-c830-4ad8-98e4-72f9e2993eea tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c" status: 404 len: 111 microversion: 2.1 time: 0.040467 Apr 14 14:45:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 343/1026] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:45:50 2023] GET /compute/v2.1/servers/47e05edc-4808-49de-b882-addd28b2258c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:45:50 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:50 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:50 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-4d4430e1-5979-453b-9b09-2f93383eb831 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Calling method '.version_select at 0x7f67dfc612d0>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:45:50 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-4d4430e1-5979-453b-9b09-2f93383eb831 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2051732308" status: 202 len: 0 microversion: 2.1 time: 0.033207 Apr 14 14:45:50 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 345/1027] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 14:45:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-2051732308 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:45:59 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:00 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:46:00 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:46:00 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:46:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6b7c4c5d-69b1-44d5-be12-888fb80c9b92 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1768 microversion: 2.87 time: 0.297772 Apr 14 14:46:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 340/1028] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:45:59 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1768 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:46:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b93d87de-b024-4fb1-a9f8-39eec62e897b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 200 len: 1379 microversion: 2.1 time: 0.242862 Apr 14 14:46:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 344/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:46:10 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 1379 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:46:10 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-6c6a9e02-2687-42ad-9298-d48ba33721af tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 200 len: 1379 microversion: 2.1 time: 0.152132 Apr 14 14:46:10 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 346/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:46:10 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 1379 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:46:10 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 204 len: 0 microversion: 2.1 time: 0.123374 Apr 14 14:46:10 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 341/1031] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:46:10 2023] DELETE /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:10 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:46:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2c5553a6-b26f-4479-9001-2aba62c75aba tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 200 len: 1385 microversion: 2.1 time: 0.185071 Apr 14 14:46:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 345/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:46:10 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 1385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:46:11 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d4aa8c-3e3b-4988-9876-1538edd88744", "name": "network-vif-unplugged", "status": "completed", "tag": "27658df0-382a-404b-afde-a2f3f50eeeb2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:46:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:11 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Creating event network-vif-unplugged:27658df0-382a-404b-afde-a2f3f50eeeb2 for instance 26d4aa8c-3e3b-4988-9876-1538edd88744 on user Apr 14 14:46:11 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201081 Apr 14 14:46:11 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 347/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:46:12 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d4aa8c-3e3b-4988-9876-1538edd88744", "name": "network-vif-deleted", "tag": "27658df0-382a-404b-afde-a2f3f50eeeb2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:46:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:12 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] Creating event network-vif-deleted:27658df0-382a-404b-afde-a2f3f50eeeb2 for instance 26d4aa8c-3e3b-4988-9876-1538edd88744 on user Apr 14 14:46:12 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030721 Apr 14 14:46:12 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 342/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:46:13 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d4aa8c-3e3b-4988-9876-1538edd88744", "name": "network-vif-plugged", "status": "completed", "tag": "27658df0-382a-404b-afde-a2f3f50eeeb2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:46:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:46:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:46:13 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:46:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Creating event network-vif-plugged:27658df0-382a-404b-afde-a2f3f50eeeb2 for instance 26d4aa8c-3e3b-4988-9876-1538edd88744 on user Apr 14 14:46:13 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042598 Apr 14 14:46:13 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 346/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:46:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "483113b9-0f50-4da7-a9eb-d95c302c95e5"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:00 user devstack@n-api.service[61716]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'flavor' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=61716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:47:00 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 HTTP/1.1 Apr 14 14:47:00 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:47:00 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:47:00 user devstack@n-api.service[61717]: Connection: close Apr 14 14:47:00 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:47:00 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:47:00 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:47:00 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:47:00 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:47:00 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:47:00 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:47:00 user devstack@n-api.service[61717]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:47:00 user devstack@n-api.service[61717]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:47:00 user devstack@n-api.service[61717]: method: > Apr 14 14:47:00 user devstack@n-api.service[61717]: exception: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:00 user devstack@n-api.service[61717]: action_args: {'id': '26d4aa8c-3e3b-4988-9876-1538edd88744'} Apr 14 14:47:00 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:00 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:47:00 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c4ff8484-20c4-4dbd-bcbf-8ca626e0f414 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 404 len: 111 microversion: 2.1 time: 0.044736 Apr 14 14:47:00 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 343/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:47:00 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:47:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2/action" status: 200 len: 29 microversion: 2.87 time: 0.549139 Apr 14 14:47:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 348/1037] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:47:00 2023] POST /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2/action => generated 29 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:47:00 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:00 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=14 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:47:01 user devstack@n-api.service[61717]: request: DELETE /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 HTTP/1.1 Apr 14 14:47:01 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:47:01 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:47:01 user devstack@n-api.service[61717]: Connection: close Apr 14 14:47:01 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:47:01 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:47:01 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:47:01 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:47:01 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:47:01 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:47:01 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:47:01 user devstack@n-api.service[61717]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:47:01 user devstack@n-api.service[61717]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:47:01 user devstack@n-api.service[61717]: method: > Apr 14 14:47:01 user devstack@n-api.service[61717]: exception: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61717]: action_args: {'id': '26d4aa8c-3e3b-4988-9876-1538edd88744'} Apr 14 14:47:01 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-0dc7dc43-c7b1-4574-8095-ce9baa6a4404 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 404 len: 111 microversion: 2.1 time: 0.028764 Apr 14 14:47:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 344/1038] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:47:01 2023] DELETE /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:47:01 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 HTTP/1.1 Apr 14 14:47:01 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:47:01 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:47:01 user devstack@n-api.service[61716]: Connection: close Apr 14 14:47:01 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:47:01 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:47:01 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:47:01 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:47:01 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:47:01 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:47:01 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:47:01 user devstack@n-api.service[61716]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:47:01 user devstack@n-api.service[61716]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:47:01 user devstack@n-api.service[61716]: method: > Apr 14 14:47:01 user devstack@n-api.service[61716]: exception: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61716]: action_args: {'id': '26d4aa8c-3e3b-4988-9876-1538edd88744'} Apr 14 14:47:01 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. Apr 14 14:47:01 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:47:01 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:47:01 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-8920d373-5c79-4f86-bb69-46d27aad61cf tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744" status: 404 len: 111 microversion: 2.1 time: 0.031600 Apr 14 14:47:01 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 349/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:47:01 2023] GET /compute/v2.1/servers/26d4aa8c-3e3b-4988-9876-1538edd88744 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:01 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:01 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-6745ded6-0ad2-409b-8c5d-8261550bd545 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1774 microversion: 2.87 time: 0.315379 Apr 14 14:47:01 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 347/1040] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:47:00 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1774 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Creating event network-vif-unplugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051217 Apr 14 14:47:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 345/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:03 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:03 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Creating event network-vif-unplugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040183 Apr 14 14:47:03 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 350/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:03 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:06 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040092 Apr 14 14:47:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 348/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:47:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034226 Apr 14 14:47:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 346/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:47:11 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-510292440", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "f69a7e0c-25ef-40b8-949d-a3d18bcc846c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6a61e399-feba-4459-a235-1ed131fcfcb1"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:11 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] validate_networks() for [('6a61e399-feba-4459-a235-1ed131fcfcb1', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:47:12 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f69a7e0c-25ef-40b8-949d-a3d18bcc846c',volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:47:12 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.948285 Apr 14 14:47:12 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 351/1045] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:47:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:47:12 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-0dd1bfd8-81fc-4696-bf98-365fc10f9c61 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:47:12 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-0dd1bfd8-81fc-4696-bf98-365fc10f9c61 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:12 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-0dd1bfd8-81fc-4696-bf98-365fc10f9c61 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:12 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-0dd1bfd8-81fc-4696-bf98-365fc10f9c61 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 200 len: 1065 microversion: 2.1 time: 0.096417 Apr 14 14:47:12 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 349/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:47:12 2023] GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 1065 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:47:14 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3225314-c927-4d5d-871a-d80442c5f8a1", "tag": "a3103941-cf0f-49a8-a2a9-28decc5e0c04"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:14 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Creating event network-changed:a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance a3225314-c927-4d5d-871a-d80442c5f8a1 on user Apr 14 14:47:14 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030847 Apr 14 14:47:14 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 347/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:21 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3225314-c927-4d5d-871a-d80442c5f8a1", "name": "network-vif-plugged", "status": "completed", "tag": "a3103941-cf0f-49a8-a2a9-28decc5e0c04"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:21 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Creating event network-vif-plugged:a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance a3225314-c927-4d5d-871a-d80442c5f8a1 on user Apr 14 14:47:21 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141326 Apr 14 14:47:21 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 352/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3225314-c927-4d5d-871a-d80442c5f8a1", "name": "network-vif-plugged", "status": "completed", "tag": "a3103941-cf0f-49a8-a2a9-28decc5e0c04"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=10 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:23 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:23 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Creating event network-vif-plugged:a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance a3225314-c927-4d5d-871a-d80442c5f8a1 on user Apr 14 14:47:23 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038809 Apr 14 14:47:23 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 350/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:51 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:47:51 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-661b161a-5961-4272-a6ff-2710d91e5ccd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1754 microversion: 2.87 time: 0.395053 Apr 14 14:47:51 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 348/1050] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:47:51 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1754 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:02 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:48:02 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-368f60fd-bfe7-4aee-b7f3-0ffc614da891 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 200 len: 1391 microversion: 2.1 time: 0.233023 Apr 14 14:48:02 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 353/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:48:02 2023] GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:51 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:51 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2/action" status: 202 len: 0 microversion: 2.87 time: 0.093264 Apr 14 14:48:51 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 351/1052] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:48:51 2023] POST /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:51 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:52 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:48:52 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:48:52 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:48:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-6a30c935-2a71-460a-9210-3132895db3e7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1762 microversion: 2.87 time: 0.532198 Apr 14 14:48:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 349/1053] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:48:51 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1762 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 14:48:52 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:48:52 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:52 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:48:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:52 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Creating event network-vif-unplugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:48:52 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037742 Apr 14 14:48:52 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 354/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:48:54 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:48:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:54 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:48:54 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028933 Apr 14 14:48:54 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 352/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:48:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:48:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:48:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:48:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:48:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:48:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 14:48:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037422 Apr 14 14:48:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 350/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:48:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:02 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:03 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:49:03 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b59cb1df-d4cd-4f3d-9a46-17815b5fe022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 200 len: 1391 microversion: 2.1 time: 0.378088 Apr 14 14:49:03 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 355/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:49:02 2023] GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 1391 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-5556420"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:03 user devstack@n-api.service[61718]: INFO nova.compute.api [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Attempting to quiesce instance before volume snapshot. Apr 14 14:49:03 user devstack@n-api.service[61718]: INFO nova.compute.api [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 14:49:03 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Creating snapshot from volume f69a7e0c-25ef-40b8-949d-a3d18bcc846c. {{(pid=61718) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 14:49:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c62142cf-496d-4490-a297-f189f72faa58 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1/action" status: 202 len: 0 microversion: 2.1 time: 2.748064 Apr 14 14:49:05 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 353/1058] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 14:49:03 2023] POST /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1/action => generated 0 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2123192446", "imageRef": "541a72c1-db43-43ba-95f6-cb3e6c2e97fa", "flavorRef": "42", "networks": [{"uuid": "6a61e399-feba-4459-a235-1ed131fcfcb1"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] validate_networks() for [('6a61e399-feba-4459-a235-1ed131fcfcb1', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:49:07 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2c27d055-a087-4312-85ef-99ec62ab93df',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:49:07 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.623391 Apr 14 14:49:07 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 351/1059] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:49:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:49:07 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b17f08de-88df-4a0a-959b-f0784523f88b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:49:07 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b17f08de-88df-4a0a-959b-f0784523f88b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:49:07 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-b17f08de-88df-4a0a-959b-f0784523f88b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:49:07 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b17f08de-88df-4a0a-959b-f0784523f88b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 200 len: 1224 microversion: 2.1 time: 0.068206 Apr 14 14:49:07 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 356/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:49:07 2023] GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 1224 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:49:10 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:49:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:10 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Creating event network-changed:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:49:10 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032611 Apr 14 14:49:10 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 354/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Creating event network-vif-plugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:49:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037748 Apr 14 14:49:24 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 352/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Creating event network-vif-plugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:49:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036055 Apr 14 14:49:26 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 357/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:49:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:49:42 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:49:42 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-756f4ccf-3b0b-46f5-a748-d27a6934faf4 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1768 microversion: 2.87 time: 0.239642 Apr 14 14:49:42 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 355/1064] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:49:42 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1768 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:49:57 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:49:58 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:49:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-adbb07a2-3772-47b9-ab09-6f1135db4b82 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 200 len: 1550 microversion: 2.1 time: 0.337953 Apr 14 14:49:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 353/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:49:57 2023] GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 1550 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:50:42 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:42 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-170009530", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "networks": [{"uuid": "8257c570-6815-4a7d-b7f5-dfb76e8c0263"}]}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:50:42 user devstack@n-api.service[61716]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] validate_networks() for [('8257c570-6815-4a7d-b7f5-dfb76e8c0263', None, None, None, None, None)] {{(pid=61716) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.quota [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for user 2e321f85d3d44c2baf210a1962f4f08f and project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Going to run 1 instances... {{(pid=61716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:50:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:50:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.616086 Apr 14 14:50:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 358/1066] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:50:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-cb6b9e57-f061-435c-b4c4-3ab16aff97a3 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-cb6b9e57-f061-435c-b4c4-3ab16aff97a3 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-cb6b9e57-f061-435c-b4c4-3ab16aff97a3 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-cb6b9e57-f061-435c-b4c4-3ab16aff97a3 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:50:43 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-cb6b9e57-f061-435c-b4c4-3ab16aff97a3 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:50:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-cb6b9e57-f061-435c-b4c4-3ab16aff97a3 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218" status: 200 len: 1394 microversion: 2.87 time: 0.078606 Apr 14 14:50:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 356/1067] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:50:43 2023] GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 => generated 1394 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:50:46 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:46 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:46 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:50:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:46 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Creating event network-changed:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 14:50:46 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090424 Apr 14 14:50:46 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 354/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:50:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:50:48 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-plugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:50:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:48 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Creating event network-vif-plugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 14:50:48 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035881 Apr 14 14:50:48 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 359/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:50:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:50:50 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-plugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:50:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:50 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Creating event network-vif-plugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 14:50:50 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031034 Apr 14 14:50:50 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 357/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:50:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:50:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-da0f398f-4cb3-42c3-b753-0769e0aa53aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 200 len: 1550 microversion: 2.1 time: 0.229876 Apr 14 14:50:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 355/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:50:58 2023] GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 1550 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:50:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 204 len: 0 microversion: 2.1 time: 0.123548 Apr 14 14:50:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 360/1072] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:50:58 2023] DELETE /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-unplugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:50:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:50:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Creating event network-vif-unplugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:50:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060003 Apr 14 14:50:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 356/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:50:59 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:50:59 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-f24ad10c-3ab0-4593-bec8-99efa1847e44 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 200 len: 1556 microversion: 2.1 time: 0.340889 Apr 14 14:50:59 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 358/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:50:58 2023] GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 1556 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:51:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-deleted", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:51:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] Creating event network-vif-deleted:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:51:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029831 Apr 14 14:51:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 361/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:51:00 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}, {"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}, {"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}, {"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-unplugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}, {"server_uuid": "a36db897-6344-4e93-924e-ddf17ad61022", "name": "network-vif-plugged", "status": "completed", "tag": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:51:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:01 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Creating event network-vif-plugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:51:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Creating event network-vif-plugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:51:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Creating event network-vif-plugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:51:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Creating event network-vif-unplugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:51:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Creating event network-vif-plugged:0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance a36db897-6344-4e93-924e-ddf17ad61022 on user Apr 14 14:51:01 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030566 Apr 14 14:51:01 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 357/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=10 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:34 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:51:34 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:51:34 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:51:34 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c224fccc-2f14-4e4c-9cf8-877495ade7d5 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218" status: 200 len: 1689 microversion: 2.87 time: 0.750825 Apr 14 14:51:34 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 359/1077] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:51:33 2023] GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 => generated 1689 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:49 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:51:49 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 HTTP/1.1 Apr 14 14:51:49 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:51:49 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:51:49 user devstack@n-api.service[61716]: Connection: close Apr 14 14:51:49 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:51:49 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:51:49 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:51:49 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:51:49 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:51:49 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:51:49 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:51:49 user devstack@n-api.service[61716]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:51:49 user devstack@n-api.service[61716]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:51:49 user devstack@n-api.service[61716]: method: > Apr 14 14:51:49 user devstack@n-api.service[61716]: exception: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:51:49 user devstack@n-api.service[61716]: action_args: {'id': 'a36db897-6344-4e93-924e-ddf17ad61022'} Apr 14 14:51:49 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:51:49 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:51:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:51:49 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3c92e596-1406-4063-9bb8-e1f6922e015e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 404 len: 111 microversion: 2.1 time: 0.037212 Apr 14 14:51:49 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 362/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:51:49 2023] GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:52 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:51:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 204 len: 0 microversion: 2.1 time: 0.142722 Apr 14 14:51:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 358/1079] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:51:52 2023] DELETE /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:52 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:51:53 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-c729af5b-fc2c-4309-9443-a0903ea7b98c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 200 len: 1397 microversion: 2.1 time: 0.489374 Apr 14 14:51:53 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 360/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:51:52 2023] GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 1397 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:51:53 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3225314-c927-4d5d-871a-d80442c5f8a1", "name": "network-vif-unplugged", "status": "completed", "tag": "a3103941-cf0f-49a8-a2a9-28decc5e0c04"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:51:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:53 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Creating event network-vif-unplugged:a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance a3225314-c927-4d5d-871a-d80442c5f8a1 on user Apr 14 14:51:53 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030178 Apr 14 14:51:53 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 363/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:51:54 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3225314-c927-4d5d-871a-d80442c5f8a1", "name": "network-vif-deleted", "tag": "a3103941-cf0f-49a8-a2a9-28decc5e0c04"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:51:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:54 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] Creating event network-vif-deleted:a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance a3225314-c927-4d5d-871a-d80442c5f8a1 on user Apr 14 14:51:54 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Apr 14 14:51:54 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 359/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:51:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 14:51:55 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3225314-c927-4d5d-871a-d80442c5f8a1", "name": "network-vif-plugged", "status": "completed", "tag": "a3103941-cf0f-49a8-a2a9-28decc5e0c04"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:51:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:51:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:51:55 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:51:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Creating event network-vif-plugged:a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance a3225314-c927-4d5d-871a-d80442c5f8a1 on user Apr 14 14:51:55 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041617 Apr 14 14:51:55 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 361/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:51:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-996233194"}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:34 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:35 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218/action" status: 202 len: 52 microversion: 2.87 time: 1.086510 Apr 14 14:52:35 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 364/1084] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:52:34 2023] POST /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218/action => generated 52 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:41 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:52:41 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:52:41 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:52:41 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-624ede07-43f7-47be-8a74-f6fd8b3a2a00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218" status: 200 len: 1689 microversion: 2.87 time: 0.235748 Apr 14 14:52:41 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 360/1085] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:52:40 2023] GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:52:43 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 HTTP/1.1 Apr 14 14:52:43 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:52:43 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:52:43 user devstack@n-api.service[61718]: Connection: close Apr 14 14:52:43 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:52:43 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:52:43 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:52:43 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:52:43 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61718]: method: > Apr 14 14:52:43 user devstack@n-api.service[61718]: exception: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: action_args: {'id': 'a3225314-c927-4d5d-871a-d80442c5f8a1'} Apr 14 14:52:43 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:52:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d0195aa2-ec5d-48f1-a379-61f1ff050cdd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 404 len: 111 microversion: 2.1 time: 0.037416 Apr 14 14:52:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 362/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:52:43 2023] GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:52:43 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 HTTP/1.1 Apr 14 14:52:43 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:52:43 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:52:43 user devstack@n-api.service[61716]: Connection: close Apr 14 14:52:43 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:52:43 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:52:43 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:52:43 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:52:43 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61716]: method: > Apr 14 14:52:43 user devstack@n-api.service[61716]: exception: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: action_args: {'id': 'a36db897-6344-4e93-924e-ddf17ad61022'} Apr 14 14:52:43 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:52:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-f1009334-798a-40ec-acd6-390da3a5bdb2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 404 len: 111 microversion: 2.1 time: 0.032158 Apr 14 14:52:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 365/1087] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:52:43 2023] DELETE /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:52:43 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 HTTP/1.1 Apr 14 14:52:43 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:52:43 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:52:43 user devstack@n-api.service[61717]: Connection: close Apr 14 14:52:43 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:52:43 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:52:43 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:52:43 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:52:43 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61717]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:52:43 user devstack@n-api.service[61717]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61717]: method: > Apr 14 14:52:43 user devstack@n-api.service[61717]: exception: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61717]: action_args: {'id': 'a36db897-6344-4e93-924e-ddf17ad61022'} Apr 14 14:52:43 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance a36db897-6344-4e93-924e-ddf17ad61022 could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:52:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-aaafc741-0926-47b6-9ccd-caee01c8e1e3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022" status: 404 len: 111 microversion: 2.1 time: 0.028108 Apr 14 14:52:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 361/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:52:43 2023] GET /compute/v2.1/servers/a36db897-6344-4e93-924e-ddf17ad61022 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:52:43 user devstack@n-api.service[61718]: request: DELETE /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 HTTP/1.1 Apr 14 14:52:43 user devstack@n-api.service[61718]: Accept: application/json Apr 14 14:52:43 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 14:52:43 user devstack@n-api.service[61718]: Connection: close Apr 14 14:52:43 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 14:52:43 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 14:52:43 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 14:52:43 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 14:52:43 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:52:43 user devstack@n-api.service[61718]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61718]: method: > Apr 14 14:52:43 user devstack@n-api.service[61718]: exception: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: action_args: {'id': 'a3225314-c927-4d5d-871a-d80442c5f8a1'} Apr 14 14:52:43 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:52:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-181c2fdd-2468-4a65-9ba9-b9d58a9b1ffe tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 404 len: 111 microversion: 2.1 time: 0.052487 Apr 14 14:52:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 363/1089] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:52:43 2023] DELETE /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:52:43 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 HTTP/1.1 Apr 14 14:52:43 user devstack@n-api.service[61716]: Accept: application/json Apr 14 14:52:43 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 14:52:43 user devstack@n-api.service[61716]: Connection: close Apr 14 14:52:43 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 14:52:43 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 14:52:43 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 14:52:43 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 14:52:43 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:52:43 user devstack@n-api.service[61716]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:52:43 user devstack@n-api.service[61716]: method: > Apr 14 14:52:43 user devstack@n-api.service[61716]: exception: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: action_args: {'id': 'a3225314-c927-4d5d-871a-d80442c5f8a1'} Apr 14 14:52:43 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. Apr 14 14:52:43 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 14:52:43 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance a3225314-c927-4d5d-871a-d80442c5f8a1 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:52:43 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-117ccf10-d81d-40c0-862f-615dda61f788 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1" status: 404 len: 111 microversion: 2.1 time: 0.030398 Apr 14 14:52:43 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 366/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:52:43 2023] GET /compute/v2.1/servers/a3225314-c927-4d5d-871a-d80442c5f8a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-5ad536e7-08cc-4b13-a9aa-55807b47be72 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: .version_select at 0x7f67e43327a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-816706035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA=="}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-5ad536e7-08cc-4b13-a9aa-55807b47be72 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:52:43 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-5ad536e7-08cc-4b13-a9aa-55807b47be72 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'key_pairs'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:52:43 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-5ad536e7-08cc-4b13-a9aa-55807b47be72 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.046838 Apr 14 14:52:43 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 362/1091] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 14:52:43 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:52:48 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-949359651", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-816706035", "security_groups": [{"name": "tempest-secgroup-smoke-955783695"}], "block_device_mapping_v2": [{"uuid": "c0e09208-c40e-4eee-b7e7-bd45c326e066", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a61e399-feba-4459-a235-1ed131fcfcb1"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:52:48 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] validate_networks() for [('6a61e399-feba-4459-a235-1ed131fcfcb1', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:52:49 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0e09208-c40e-4eee-b7e7-bd45c326e066',volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:52:49 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.005672 Apr 14 14:52:49 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 364/1092] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:52:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:52:49 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-24895c3b-115f-440d-b5c8-887994683093 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:52:49 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-24895c3b-115f-440d-b5c8-887994683093 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:52:49 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-24895c3b-115f-440d-b5c8-887994683093 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:52:49 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-24895c3b-115f-440d-b5c8-887994683093 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 200 len: 1088 microversion: 2.1 time: 0.072907 Apr 14 14:52:49 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:52:49 2023] GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:52:52 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:52:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:52 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Creating event network-changed:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:52:52 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031589 Apr 14 14:52:52 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 363/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:52:58 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "name": "network-vif-plugged", "status": "completed", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:52:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:52:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:52:58 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:52:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Creating event network-vif-plugged:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:52:58 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107841 Apr 14 14:52:58 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 365/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "name": "network-vif-plugged", "status": "completed", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:00 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Creating event network-vif-plugged:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:53:00 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034922 Apr 14 14:53:00 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 368/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:40 user devstack@n-api.service[61717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 14:53:40 user devstack@n-api.service[61717]: Fri Apr 14 14:53:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a (ip 10.0.0.210) !!! Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=10 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:40 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:53:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-56f9e899-8edf-4e91-ab54-bfbe97c0d006 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 200 len: 1440 microversion: 2.1 time: 0.272859 Apr 14 14:53:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 364/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:53:40 2023] GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 1440 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1469413864", "imageRef": "79416463-b265-4588-8d03-bcb84f0ecc83", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "79416463-b265-4588-8d03-bcb84f0ecc83", "destination_type": "volume"}], "networks": [{"uuid": "8257c570-6815-4a7d-b7f5-dfb76e8c0263"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] validate_networks() for [('8257c570-6815-4a7d-b7f5-dfb76e8c0263', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting quotas for user 2e321f85d3d44c2baf210a1962f4f08f and project 2241300ad3704734aed3990cc7aadc1b. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:53:41 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='79416463-b265-4588-8d03-bcb84f0ecc83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:53:41 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.631701 Apr 14 14:53:41 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 366/1098] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 14:53:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 14:53:41 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:41 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-99f103f5-0f3d-455a-96cd-eb345235bc00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:53:41 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-99f103f5-0f3d-455a-96cd-eb345235bc00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:53:41 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-99f103f5-0f3d-455a-96cd-eb345235bc00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:53:41 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-99f103f5-0f3d-455a-96cd-eb345235bc00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:53:41 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-99f103f5-0f3d-455a-96cd-eb345235bc00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:53:41 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-99f103f5-0f3d-455a-96cd-eb345235bc00 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1395 microversion: 2.87 time: 0.084235 Apr 14 14:53:41 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 369/1099] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:53:41 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1395 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:53:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:53:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Creating event network-changed:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:53:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030645 Apr 14 14:53:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 365/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:53:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094333 Apr 14 14:53:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 367/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:53:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:53:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:53:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:53:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033633 Apr 14 14:53:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 370/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:53:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:54:31 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:31 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:54:31 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:54:32 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:54:32 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c1345366-3327-430c-9bdd-dc7f28897388 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1768 microversion: 2.87 time: 0.296297 Apr 14 14:54:32 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 366/1103] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:54:31 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1768 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:40 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:54:40 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-97f37851-0719-4b66-8a19-4ff4e2a12d59 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 200 len: 1440 microversion: 2.1 time: 0.386262 Apr 14 14:54:40 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:54:40 2023] GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 1440 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:54:42 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:42 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:42 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:54:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:42 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Creating event network-changed:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:54:42 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034470 Apr 14 14:54:42 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 371/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:42 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:54:42 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 204 len: 0 microversion: 2.1 time: 0.114299 Apr 14 14:54:42 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 367/1106] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:54:42 2023] DELETE /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:42 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:43 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:54:43 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-45e2bc24-2e9a-4a5c-93c5-7ff05526e61e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 200 len: 1446 microversion: 2.1 time: 0.203304 Apr 14 14:54:43 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 369/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:54:42 2023] GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 1446 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:54:44 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "name": "network-vif-unplugged", "status": "completed", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}, {"server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "name": "network-vif-plugged", "status": "completed", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:54:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:44 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Creating event network-vif-unplugged:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:54:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Creating event network-vif-plugged:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:54:44 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029716 Apr 14 14:54:44 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 372/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:54:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:54:45 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb195da3-b027-4af6-9c2e-cb8728368d6a", "name": "network-vif-deleted", "tag": "e72fe350-d8b1-48d0-97a5-459536237a04"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:54:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:54:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:54:45 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:54:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] Creating event network-vif-deleted:e72fe350-d8b1-48d0-97a5-459536237a04 for instance bb195da3-b027-4af6-9c2e-cb8728368d6a on user Apr 14 14:54:45 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030736 Apr 14 14:54:45 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 368/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "5b13b293-128b-466a-956d-60c9a34863d9"}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=12 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:32 user devstack@n-api.service[61718]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'flavor' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=61718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 14:55:33 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b/action" status: 200 len: 29 microversion: 2.87 time: 0.426161 Apr 14 14:55:33 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 370/1110] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:55:32 2023] POST /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b/action => generated 29 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61717]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 14:55:33 user devstack@n-api.service[61717]: Fri Apr 14 14:55:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a (ip 10.0.0.210) !!! Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 14:55:33 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a HTTP/1.1 Apr 14 14:55:33 user devstack@n-api.service[61717]: Accept: application/json Apr 14 14:55:33 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 14:55:33 user devstack@n-api.service[61717]: Connection: close Apr 14 14:55:33 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 14:55:33 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 14:55:33 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 14:55:33 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 14:55:33 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:55:33 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 14:55:33 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 14:55:33 user devstack@n-api.service[61717]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 14:55:33 user devstack@n-api.service[61717]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 14:55:33 user devstack@n-api.service[61717]: method: > Apr 14 14:55:33 user devstack@n-api.service[61717]: exception: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 14:55:33 user devstack@n-api.service[61717]: action_args: {'id': 'bb195da3-b027-4af6-9c2e-cb8728368d6a'} Apr 14 14:55:33 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 14:55:33 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 14:55:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8fca9871-a71d-41ec-a310-2052d348401b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 404 len: 111 microversion: 2.1 time: 0.037488 Apr 14 14:55:33 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 369/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:55:33 2023] GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-585640922", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-816706035", "security_groups": [{"name": "tempest-secgroup-smoke-955783695"}], "block_device_mapping_v2": [{"uuid": "c0e09208-c40e-4eee-b7e7-bd45c326e066", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a61e399-feba-4459-a235-1ed131fcfcb1"}]}} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:55:33 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:55:33 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3e93466b-bd95-4791-9dac-e7df3a598197 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1774 microversion: 2.87 time: 0.333198 Apr 14 14:55:33 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 373/1112] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:55:33 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1774 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] validate_networks() for [('6a61e399-feba-4459-a235-1ed131fcfcb1', None, None, None, None, None)] {{(pid=61718) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:33 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Creating event network-vif-unplugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:33 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030915 Apr 14 14:55:33 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 370/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:55:33 user devstack@n-api.service[61718]: DEBUG nova.quota [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61718) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:55:34 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Going to run 1 instances... {{(pid=61718) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:55:34 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0e09208-c40e-4eee-b7e7-bd45c326e066',volume_size=None,volume_type=None)] {{(pid=61718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:55:34 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.861476 Apr 14 14:55:34 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 371/1114] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:55:33 2023] POST /compute/v2.1/servers => generated 403 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:55:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-b66db2af-c580-4f7a-913b-7278625bd6b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:55:34 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-b66db2af-c580-4f7a-913b-7278625bd6b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:55:34 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-b66db2af-c580-4f7a-913b-7278625bd6b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:55:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-b66db2af-c580-4f7a-913b-7278625bd6b2 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d" status: 200 len: 1088 microversion: 2.1 time: 0.088609 Apr 14 14:55:34 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 374/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:55:34 2023] GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d => generated 1088 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:55:36 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}, {"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}, {"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:36 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:36 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.073679 Apr 14 14:55:36 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 371/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}, {"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Creating event network-vif-unplugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050873 Apr 14 14:55:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 372/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:38 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:38 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:38 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Creating event network-changed:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 14:55:38 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032179 Apr 14 14:55:38 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 375/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:40 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}, {"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:40 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:55:40 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042230 Apr 14 14:55:40 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 372/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:44 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:44 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell0:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:44 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "name": "network-vif-plugged", "status": "completed", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:44 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Creating event network-vif-plugged:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 14:55:45 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037281 Apr 14 14:55:45 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 373/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:55:47 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:55:47 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "name": "network-vif-plugged", "status": "completed", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:55:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:55:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:55:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:55:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Creating event network-vif-plugged:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 14:55:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141626 Apr 14 14:55:47 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 376/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:55:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:56:23 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:56:23 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d1364681-6970-4489-a610-3a6bd6ad3a2d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1754 microversion: 2.87 time: 0.367031 Apr 14 14:56:23 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 373/1122] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:56:23 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1754 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:56:24 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:56:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-57d1ea0a-3583-4c62-932e-122718821403 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d" status: 200 len: 1439 microversion: 2.1 time: 0.354970 Apr 14 14:56:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 374/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:56:24 2023] GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d => generated 1439 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:57:23 user devstack@n-api.service[61716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 14:57:23 user devstack@n-api.service[61716]: Fri Apr 14 14:57:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b/action (ip 10.0.0.210) !!! Apr 14 14:57:23 user devstack@n-api.service[61716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 14:57:23 user devstack@n-api.service[61716]: Fri Apr 14 14:57:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b/action (ip 10.0.0.210) !!! Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=12 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:23 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:23 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b/action" status: 202 len: 0 microversion: 2.87 time: 0.088367 Apr 14 14:57:23 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 377/1124] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 14:57:23 2023] POST /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:57:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:23 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:57:24 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:57:24 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-7a208a72-4c26-4bd8-85ee-0577463b044a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1762 microversion: 2.87 time: 0.363352 Apr 14 14:57:24 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 374/1125] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:57:23 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1762 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:24 user devstack@n-api.service[61718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 14:57:24 user devstack@n-api.service[61718]: Fri Apr 14 14:57:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d (ip 10.0.0.210) !!! Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:24 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:24 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Creating event network-vif-unplugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:57:24 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030761 Apr 14 14:57:24 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 378/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:57:24 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:57:24 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-322c2ece-970e-4f0a-af62-caf4a1b7b272 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d" status: 200 len: 1439 microversion: 2.1 time: 0.260334 Apr 14 14:57:24 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 375/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:57:24 2023] GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d => generated 1439 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:57:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Creating event network-changed:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 14:57:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027386 Apr 14 14:57:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 375/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:57:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}, {"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:57:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:57:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031595 Apr 14 14:57:26 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 379/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:57:29 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:57:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052395 Apr 14 14:57:29 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 376/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:57:33 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-506145245", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-816706035", "security_groups": [{"name": "tempest-secgroup-smoke-955783695"}], "block_device_mapping_v2": [{"uuid": "813cbaf0-f5d6-4da5-9c67-816f8c1e417d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a61e399-feba-4459-a235-1ed131fcfcb1"}]}} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:33 user devstack@n-api.service[61717]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] validate_networks() for [('6a61e399-feba-4459-a235-1ed131fcfcb1', None, None, None, None, None)] {{(pid=61717) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61717) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.quota [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting quotas for user 43b5d8526a7c4b0fb5f15a8345b229e2 and project e217ba6818e94879aa02015ccf21b058. Resources: {'cores', 'instances', 'ram'} {{(pid=61717) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Going to run 1 instances... {{(pid=61717) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 14:57:34 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='813cbaf0-f5d6-4da5-9c67-816f8c1e417d',volume_size=None,volume_type=None)] {{(pid=61717) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 14:57:34 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.906318 Apr 14 14:57:34 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 376/1131] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 14:57:33 2023] POST /compute/v2.1/servers => generated 403 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 14:57:34 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-7022670b-f5d5-4ff7-a2b1-c02fe92c8388 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:57:34 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-7022670b-f5d5-4ff7-a2b1-c02fe92c8388 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:57:34 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-7022670b-f5d5-4ff7-a2b1-c02fe92c8388 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:57:34 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-7022670b-f5d5-4ff7-a2b1-c02fe92c8388 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09" status: 200 len: 1088 microversion: 2.1 time: 0.107422 Apr 14 14:57:34 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 380/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:57:34 2023] GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 14:57:38 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:38 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Creating event network-changed:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:57:38 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041757 Apr 14 14:57:38 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 377/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:57:44 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "name": "network-vif-plugged", "status": "completed", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:44 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Creating event network-vif-plugged:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:57:44 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Apr 14 14:57:44 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 377/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "name": "network-vif-plugged", "status": "completed", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=10 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell0:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:57:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:57:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Creating event network-vif-plugged:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:57:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034602 Apr 14 14:57:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 381/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=10 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:58:14 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:58:14 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-04eba593-5cad-4ced-a1ca-988d3833b7d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1768 microversion: 2.87 time: 0.246566 Apr 14 14:58:14 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 378/1136] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:58:14 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1768 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell0:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=12 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:58:24 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:58:25 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:58:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-bf361079-b63d-4c1c-8ee3-562dc39083aa tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09" status: 200 len: 1440 microversion: 2.1 time: 0.314109 Apr 14 14:58:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 378/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:58:24 2023] GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 => generated 1440 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:59:14 user devstack@n-api.service[61716]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3aa96b0c-05b7-47ec-9111-746db7078f93] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:14 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:59:14 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 204 len: 0 microversion: 2.87 time: 0.241168 Apr 14 14:59:14 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 382/1138] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 14:59:14 2023] DELETE /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:14 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:15 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:59:15 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:59:15 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:59:15 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-5a4882c5-f5af-4d83-a47a-1b7f39550b1d tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 200 len: 1774 microversion: 2.87 time: 0.276842 Apr 14 14:59:15 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 379/1139] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 14:59:14 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 1774 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 14:59:15 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:15 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=6 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:15 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:15 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:15 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:15 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Creating event network-vif-unplugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:59:15 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106704 Apr 14 14:59:15 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 379/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:16 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-deleted", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:16 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:16 user devstack@n-api.service[61716]: INFO oslo.messaging._drivers.impl_rabbit [-] [3aa96b0c-05b7-47ec-9111-746db7078f93] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40326. Apr 14 14:59:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] Creating event network-vif-deleted:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:59:16 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036856 Apr 14 14:59:16 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 383/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:17 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8325185-b8d9-410c-9da5-2ec5ee09620b", "name": "network-vif-plugged", "status": "completed", "tag": "0e83d513-46c5-48cd-bcbe-9ae926f887a2"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:17 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Creating event network-vif-plugged:0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance e8325185-b8d9-410c-9da5-2ec5ee09620b on user Apr 14 14:59:17 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030840 Apr 14 14:59:17 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 380/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:25 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:59:25 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-8f78af17-071b-461c-a7e6-67a0117511ec tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09" status: 200 len: 1440 microversion: 2.1 time: 0.450689 Apr 14 14:59:25 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 380/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:59:25 2023] GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 => generated 1440 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:59:27 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:27 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:27 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:27 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Creating event network-changed:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:59:27 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032468 Apr 14 14:59:27 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 384/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=6 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:28 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Going to try to terminate instance {{(pid=61718) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 14:59:28 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09" status: 204 len: 0 microversion: 2.1 time: 0.136841 Apr 14 14:59:28 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 381/1145] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 14:59:28 2023] DELETE /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:28 user devstack@n-api.service[61717]: DEBUG nova.policy [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61717) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 14:59:28 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-b3bd6417-f7c4-46cb-8483-48993b9086a5 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09" status: 200 len: 1565 microversion: 2.1 time: 0.160535 Apr 14 14:59:28 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 381/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 14:59:28 2023] GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 14:59:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "name": "network-vif-unplugged", "status": "completed", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:29 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Creating event network-vif-unplugged:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:59:29 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098002 Apr 14 14:59:29 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 385/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:29 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:29 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Creating event network-changed:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:59:29 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029837 Apr 14 14:59:29 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 382/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:31 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "name": "network-vif-plugged", "status": "completed", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:31 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Creating event network-vif-plugged:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:59:31 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035660 Apr 14 14:59:31 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 382/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 14:59:31 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b381b0d5-3e84-422a-90d7-154041818f09", "name": "network-vif-deleted", "tag": "fa812b04-be77-4793-92ba-dd4550d6a682"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 14:59:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 14:59:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 14:59:31 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 14:59:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] Creating event network-vif-deleted:fa812b04-be77-4793-92ba-dd4550d6a682 for instance b381b0d5-3e84-422a-90d7-154041818f09 on user Apr 14 14:59:31 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034819 Apr 14 14:59:31 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 386/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 14:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HTTP exception thrown: Instance e8325185-b8d9-410c-9da5-2ec5ee09620b could not be found. Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Request method failure captured: Apr 14 15:00:05 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b HTTP/1.1 Apr 14 15:00:05 user devstack@n-api.service[61718]: Accept: application/json Apr 14 15:00:05 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 15:00:05 user devstack@n-api.service[61718]: Connection: close Apr 14 15:00:05 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 15:00:05 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 15:00:05 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 15:00:05 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 15:00:05 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWZC_EmrvjTeC_YhxhgWYvFmp62fy4kbELMs3v0FkyqiTyX2XEoJ2cPcpG2QtwMB8Y3T5HBHEgh6yTRtE0DDIb91h3y8rKaUFXkat0OmvvUcSybHuHRflQblk8KZsMt897Yvy15bXRuOQC5H-JmmOjNBpyNRNayDyphbMloaBIMoHVM Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Project-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Tenant-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:00:05 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:00:05 user devstack@n-api.service[61718]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:00:05 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 15:00:05 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 15:00:05 user devstack@n-api.service[61718]: X-User-Id: 2e321f85d3d44c2baf210a1962f4f08f Apr 14 15:00:05 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:00:05 user devstack@n-api.service[61718]: method: > Apr 14 15:00:05 user devstack@n-api.service[61718]: exception: Instance e8325185-b8d9-410c-9da5-2ec5ee09620b could not be found. Apr 14 15:00:05 user devstack@n-api.service[61718]: action_args: {'id': 'e8325185-b8d9-410c-9da5-2ec5ee09620b'} Apr 14 15:00:05 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8325185-b8d9-410c-9da5-2ec5ee09620b could not be found. Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8325185-b8d9-410c-9da5-2ec5ee09620b could not be found. Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8325185-b8d9-410c-9da5-2ec5ee09620b could not be found. Apr 14 15:00:05 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Returning 404 to user: Instance e8325185-b8d9-410c-9da5-2ec5ee09620b could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:00:05 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-cca4480f-e110-40dc-bae5-f8554dd39bcf tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b" status: 404 len: 111 microversion: 2.87 time: 0.042435 Apr 14 15:00:05 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 383/1151] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:00:05 2023] GET /compute/v2.1/servers/e8325185-b8d9-410c-9da5-2ec5ee09620b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=8 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=16 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:05 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:00:05 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218" status: 204 len: 0 microversion: 2.87 time: 0.134290 Apr 14 15:00:05 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 383/1152] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:00:05 2023] DELETE /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:05 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:05 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-unplugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:06 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Creating event network-vif-unplugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:06 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:06 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046369 Apr 14 15:00:06 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 384/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:06 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:06 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:06 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-08acfd7a-fd99-4aca-bf9f-3b786cef3d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218" status: 200 len: 1695 microversion: 2.87 time: 0.325343 Apr 14 15:00:06 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 387/1154] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:00:05 2023] GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 => generated 1695 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:00:08 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-plugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}, {"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-plugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}, {"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-plugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}, {"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-unplugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}, {"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-plugged", "status": "completed", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}, {"server_uuid": "56e1230b-ac3c-4234-96ff-c3731f7b8218", "name": "network-vif-deleted", "tag": "08093479-30c5-4e51-a7fd-5e6e1a3382b6"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:08 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Creating event network-vif-plugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Creating event network-vif-plugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Creating event network-vif-plugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Creating event network-vif-unplugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Creating event network-vif-plugged:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Creating event network-vif-deleted:08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 on user Apr 14 15:00:08 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.034827 Apr 14 15:00:08 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 384/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:08 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance b381b0d5-3e84-422a-90d7-154041818f09 could not be found. Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 15:00:18 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 HTTP/1.1 Apr 14 15:00:18 user devstack@n-api.service[61718]: Accept: application/json Apr 14 15:00:18 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 15:00:18 user devstack@n-api.service[61718]: Connection: close Apr 14 15:00:18 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 15:00:18 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 15:00:18 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 15:00:18 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 15:00:18 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:00:18 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 15:00:18 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 15:00:18 user devstack@n-api.service[61718]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 15:00:18 user devstack@n-api.service[61718]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:00:18 user devstack@n-api.service[61718]: method: > Apr 14 15:00:18 user devstack@n-api.service[61718]: exception: Instance b381b0d5-3e84-422a-90d7-154041818f09 could not be found. Apr 14 15:00:18 user devstack@n-api.service[61718]: action_args: {'id': 'b381b0d5-3e84-422a-90d7-154041818f09'} Apr 14 15:00:18 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b381b0d5-3e84-422a-90d7-154041818f09 could not be found. Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b381b0d5-3e84-422a-90d7-154041818f09 could not be found. Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b381b0d5-3e84-422a-90d7-154041818f09 could not be found. Apr 14 15:00:18 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:18 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance b381b0d5-3e84-422a-90d7-154041818f09 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:00:18 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8c47b495-814c-469e-b175-a03762c5317b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09" status: 404 len: 111 microversion: 2.1 time: 0.098329 Apr 14 15:00:18 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 385/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:00:18 2023] GET /compute/v2.1/servers/b381b0d5-3e84-422a-90d7-154041818f09 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:26 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Going to try to terminate instance {{(pid=61716) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Creating event network-changed:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 15:00:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052280 Apr 14 15:00:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 385/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:26 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d" status: 204 len: 0 microversion: 2.1 time: 0.115232 Apr 14 15:00:26 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 388/1158] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:00:26 2023] DELETE /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:26 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:26 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-8603cda5-2cf0-4d43-acd9-893ec0fa2022 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d" status: 200 len: 1564 microversion: 2.1 time: 0.329139 Apr 14 15:00:26 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 386/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:00:26 2023] GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d => generated 1564 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:26 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Creating event network-vif-unplugged:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 15:00:26 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028803 Apr 14 15:00:26 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 386/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:28 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "name": "network-vif-plugged", "status": "completed", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}, {"server_uuid": "48b4950e-98c1-41b1-b578-7c2d2ddddc3d", "name": "network-vif-deleted", "tag": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:28 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Creating event network-vif-plugged:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 15:00:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Creating event network-vif-deleted:7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d on user Apr 14 15:00:28 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036755 Apr 14 15:00:28 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 389/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=8 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HTTP exception thrown: Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 could not be found. Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Request method failure captured: Apr 14 15:00:56 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 HTTP/1.1 Apr 14 15:00:56 user devstack@n-api.service[61718]: Accept: application/json Apr 14 15:00:56 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 15:00:56 user devstack@n-api.service[61718]: Connection: close Apr 14 15:00:56 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 15:00:56 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 15:00:56 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 15:00:56 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 15:00:56 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWZC_EmrvjTeC_YhxhgWYvFmp62fy4kbELMs3v0FkyqiTyX2XEoJ2cPcpG2QtwMB8Y3T5HBHEgh6yTRtE0DDIb91h3y8rKaUFXkat0OmvvUcSybHuHRflQblk8KZsMt897Yvy15bXRuOQC5H-JmmOjNBpyNRNayDyphbMloaBIMoHVM Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Project-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Tenant-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:00:56 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:00:56 user devstack@n-api.service[61718]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:00:56 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 15:00:56 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 15:00:56 user devstack@n-api.service[61718]: X-User-Id: 2e321f85d3d44c2baf210a1962f4f08f Apr 14 15:00:56 user devstack@n-api.service[61718]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:00:56 user devstack@n-api.service[61718]: method: > Apr 14 15:00:56 user devstack@n-api.service[61718]: exception: Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 could not be found. Apr 14 15:00:56 user devstack@n-api.service[61718]: action_args: {'id': '56e1230b-ac3c-4234-96ff-c3731f7b8218'} Apr 14 15:00:56 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 could not be found. Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 could not be found. Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 could not be found. Apr 14 15:00:56 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Returning 404 to user: Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:00:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-e9be88f1-7ce9-4990-b73d-f910f04f4a6c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218" status: 404 len: 111 microversion: 2.87 time: 0.034336 Apr 14 15:00:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 387/1162] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:00:56 2023] GET /compute/v2.1/servers/56e1230b-ac3c-4234-96ff-c3731f7b8218 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=4 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:00:56 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 204 len: 0 microversion: 2.87 time: 0.116974 Apr 14 15:00:56 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 387/1163] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:00:56 2023] DELETE /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:56 user devstack@n-api.service[61716]: DEBUG nova.policy [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61716) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:00:56 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-3899f054-7c5c-4fe1-bed8-e001edb65d48 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 200 len: 1774 microversion: 2.87 time: 0.313015 Apr 14 15:00:56 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 390/1164] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:00:56 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 1774 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:56 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.compute.server_external_events [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Creating event network-vif-unplugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:56 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035877 Apr 14 15:00:56 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 388/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:58 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}, {"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-plugged", "status": "completed", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:58 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bcfbdd-5fc4-4c83-8d67-f660404766b2", "name": "network-vif-deleted", "tag": "f9319e65-c182-46c2-8bed-b519138df9fc"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:00:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:58 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:00:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:00:58 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:00:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Creating event network-vif-unplugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Creating event network-vif-plugged:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] Creating event network-vif-deleted:f9319e65-c182-46c2-8bed-b519138df9fc for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 on user Apr 14 15:00:58 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032245 Apr 14 15:00:58 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 391/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:00:58 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086069 Apr 14 15:00:58 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 388/1167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=4 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:16 user devstack@n-api.service[61718]: INFO nova.api.openstack.wsgi [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d could not be found. Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 15:01:16 user devstack@n-api.service[61718]: request: GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d HTTP/1.1 Apr 14 15:01:16 user devstack@n-api.service[61718]: Accept: application/json Apr 14 15:01:16 user devstack@n-api.service[61718]: Accept-Encoding: identity Apr 14 15:01:16 user devstack@n-api.service[61718]: Connection: close Apr 14 15:01:16 user devstack@n-api.service[61718]: Content-Length: 0 Apr 14 15:01:16 user devstack@n-api.service[61718]: Content-Type: application/json Apr 14 15:01:16 user devstack@n-api.service[61718]: Host: 10.0.0.210 Apr 14 15:01:16 user devstack@n-api.service[61718]: Openstack-System-Scope: None Apr 14 15:01:16 user devstack@n-api.service[61718]: User-Agent: python-urllib3/1.26.15 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Domain-Id: None Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Domain-Name: None Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Identity-Status: Confirmed Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Is-Admin-Project: True Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Project-Domain-Id: default Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Project-Domain-Name: Default Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Role: member,reader Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Roles: member,reader Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:01:16 user devstack@n-api.service[61718]: X-User-Domain-Id: default Apr 14 15:01:16 user devstack@n-api.service[61718]: X-User-Domain-Name: Default Apr 14 15:01:16 user devstack@n-api.service[61718]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 15:01:16 user devstack@n-api.service[61718]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:01:16 user devstack@n-api.service[61718]: method: > Apr 14 15:01:16 user devstack@n-api.service[61718]: exception: Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d could not be found. Apr 14 15:01:16 user devstack@n-api.service[61718]: action_args: {'id': '48b4950e-98c1-41b1-b578-7c2d2ddddc3d'} Apr 14 15:01:16 user devstack@n-api.service[61718]: {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d could not be found. Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d could not be found. Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d could not be found. Apr 14 15:01:16 user devstack@n-api.service[61718]: ERROR nova.api.openstack.wsgi Apr 14 15:01:16 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d could not be found. {{(pid=61718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:01:16 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-99d7b0d0-7a1a-4340-8e76-2bf77d094f41 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d" status: 404 len: 111 microversion: 2.1 time: 0.036615 Apr 14 15:01:16 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 389/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:01:16 2023] GET /compute/v2.1/servers/48b4950e-98c1-41b1-b578-7c2d2ddddc3d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=6 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=8 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:17 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 15:01:17 user devstack@n-api.service[61716]: request: DELETE /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a HTTP/1.1 Apr 14 15:01:17 user devstack@n-api.service[61716]: Accept: application/json Apr 14 15:01:17 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 15:01:17 user devstack@n-api.service[61716]: Connection: close Apr 14 15:01:17 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 15:01:17 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 15:01:17 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 15:01:17 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 15:01:17 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:01:17 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 15:01:17 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 15:01:17 user devstack@n-api.service[61716]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 15:01:17 user devstack@n-api.service[61716]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:01:17 user devstack@n-api.service[61716]: method: > Apr 14 15:01:17 user devstack@n-api.service[61716]: exception: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61716]: action_args: {'id': 'bb195da3-b027-4af6-9c2e-cb8728368d6a'} Apr 14 15:01:17 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:01:17 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-dc77a40b-3405-4d82-b931-1214f6dfac05 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 404 len: 111 microversion: 2.1 time: 0.035859 Apr 14 15:01:17 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 392/1169] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 15:01:17 2023] DELETE /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:17 user devstack@n-api.service[61717]: INFO nova.api.openstack.wsgi [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HTTP exception thrown: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Request method failure captured: Apr 14 15:01:17 user devstack@n-api.service[61717]: request: GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a HTTP/1.1 Apr 14 15:01:17 user devstack@n-api.service[61717]: Accept: application/json Apr 14 15:01:17 user devstack@n-api.service[61717]: Accept-Encoding: identity Apr 14 15:01:17 user devstack@n-api.service[61717]: Connection: close Apr 14 15:01:17 user devstack@n-api.service[61717]: Content-Length: 0 Apr 14 15:01:17 user devstack@n-api.service[61717]: Content-Type: application/json Apr 14 15:01:17 user devstack@n-api.service[61717]: Host: 10.0.0.210 Apr 14 15:01:17 user devstack@n-api.service[61717]: Openstack-System-Scope: None Apr 14 15:01:17 user devstack@n-api.service[61717]: User-Agent: python-urllib3/1.26.15 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Auth-Token: gAAAAABkOWazs3BDp_I4LmEruEF0Hteq5Ec3-6UN08FgEUGyXthU5vuadQzUOhFyYznMR8NTXvjA7bNDUX6bKLA82DZVOIT_GidhqDc3TKOBCAKIQiswPLfyWOBKmqBCLVtuJp2HqUT-f1Z8adb4Pj0NpDe8TCKfer23yoUW61wAucuDZVkFs_w Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Domain-Id: None Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Domain-Name: None Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Identity-Status: Confirmed Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Is-Admin-Project: True Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Project-Domain-Id: default Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Project-Domain-Name: Default Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Project-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Project-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Role: member,reader Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Roles: member,reader Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e217ba6818e94879aa02015ccf21b058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Tenant: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Tenant-Id: e217ba6818e94879aa02015ccf21b058 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-Tenant-Name: tempest-TestVolumeBootPattern-152189831 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-User: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:01:17 user devstack@n-api.service[61717]: X-User-Domain-Id: default Apr 14 15:01:17 user devstack@n-api.service[61717]: X-User-Domain-Name: Default Apr 14 15:01:17 user devstack@n-api.service[61717]: X-User-Id: 43b5d8526a7c4b0fb5f15a8345b229e2 Apr 14 15:01:17 user devstack@n-api.service[61717]: X-User-Name: tempest-TestVolumeBootPattern-152189831-project-member Apr 14 15:01:17 user devstack@n-api.service[61717]: method: > Apr 14 15:01:17 user devstack@n-api.service[61717]: exception: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61717]: action_args: {'id': 'bb195da3-b027-4af6-9c2e-cb8728368d6a'} Apr 14 15:01:17 user devstack@n-api.service[61717]: {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. Apr 14 15:01:17 user devstack@n-api.service[61717]: ERROR nova.api.openstack.wsgi Apr 14 15:01:17 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Returning 404 to user: Instance bb195da3-b027-4af6-9c2e-cb8728368d6a could not be found. {{(pid=61717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:01:17 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-c7faffe9-6ab8-4d66-aa8c-2a20bd5a93bc tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a" status: 404 len: 111 microversion: 2.1 time: 0.036224 Apr 14 15:01:17 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 389/1170] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 15:01:17 2023] GET /compute/v2.1/servers/bb195da3-b027-4af6-9c2e-cb8728368d6a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 15:01:20 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-01a3fdfe-6fd6-4e1a-ada2-8f37c885d3bd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Calling method '.version_select at 0x7f67dffbcf70>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:20 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-01a3fdfe-6fd6-4e1a-ada2-8f37c885d3bd tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-816706035" status: 202 len: 0 microversion: 2.1 time: 0.028459 Apr 14 15:01:20 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 390/1171] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 15:01:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-816706035 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=2 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HTTP exception thrown: Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 could not be found. Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Request method failure captured: Apr 14 15:01:46 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 HTTP/1.1 Apr 14 15:01:46 user devstack@n-api.service[61716]: Accept: application/json Apr 14 15:01:46 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 15:01:46 user devstack@n-api.service[61716]: Connection: close Apr 14 15:01:46 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 15:01:46 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 15:01:46 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 15:01:46 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 15:01:46 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWZC_EmrvjTeC_YhxhgWYvFmp62fy4kbELMs3v0FkyqiTyX2XEoJ2cPcpG2QtwMB8Y3T5HBHEgh6yTRtE0DDIb91h3y8rKaUFXkat0OmvvUcSybHuHRflQblk8KZsMt897Yvy15bXRuOQC5H-JmmOjNBpyNRNayDyphbMloaBIMoHVM Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Project-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Tenant-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:01:46 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:01:46 user devstack@n-api.service[61716]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:01:46 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 15:01:46 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 15:01:46 user devstack@n-api.service[61716]: X-User-Id: 2e321f85d3d44c2baf210a1962f4f08f Apr 14 15:01:46 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:01:46 user devstack@n-api.service[61716]: method: > Apr 14 15:01:46 user devstack@n-api.service[61716]: exception: Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 could not be found. Apr 14 15:01:46 user devstack@n-api.service[61716]: action_args: {'id': '43bcfbdd-5fc4-4c83-8d67-f660404766b2'} Apr 14 15:01:46 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 could not be found. Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 could not be found. Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 could not be found. Apr 14 15:01:46 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:01:46 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Returning 404 to user: Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:01:46 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-945431d5-32b1-4124-a407-3818fe9801c7 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2" status: 404 len: 111 microversion: 2.87 time: 0.031906 Apr 14 15:01:46 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 393/1172] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:01:46 2023] GET /compute/v2.1/servers/43bcfbdd-5fc4-4c83-8d67-f660404766b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61717) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG dbcounter [-] [61717] Writing DB stats nova_api:SELECT=2 {{(pid=61717) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:47 user devstack@n-api.service[61717]: DEBUG nova.compute.api [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Going to try to terminate instance {{(pid=61717) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 15:01:47 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b" status: 204 len: 0 microversion: 2.87 time: 0.107978 Apr 14 15:01:47 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 390/1173] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 15:01:47 2023] DELETE /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_cell1:SELECT=2 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG dbcounter [-] [61718] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61718) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG nova.api.openstack.wsgi [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG nova.compute.api [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61718) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG oslo_concurrency.lockutils [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61718) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:47 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf7382e-7ffd-4f89-8b79-e8616462c61b", "name": "network-vif-unplugged", "status": "completed", "tag": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40"}]} {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:01:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:47 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:01:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.compute.server_external_events [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Creating event network-vif-unplugged:3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b on user Apr 14 15:01:47 user devstack@n-api.service[61718]: DEBUG nova.policy [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61718) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 15:01:47 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027403 Apr 14 15:01:47 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 394/1174] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:01:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:01:47 user devstack@n-api.service[61718]: INFO nova.api.openstack.requestlog [None req-600ba255-96cc-4535-872d-8dc189362c1b tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b" status: 200 len: 1695 microversion: 2.87 time: 0.290665 Apr 14 15:01:47 user devstack@n-api.service[61718]: [pid: 61718|app: 0|req: 391/1175] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:01:47 2023] GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b => generated 1695 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 15:01:49 user devstack@n-api.service[61717]: DEBUG nova.api.openstack.wsgi [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf7382e-7ffd-4f89-8b79-e8616462c61b", "name": "network-vif-plugged", "status": "completed", "tag": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40"}, {"server_uuid": "2bf7382e-7ffd-4f89-8b79-e8616462c61b", "name": "network-vif-deleted", "tag": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40"}]} {{(pid=61717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 15:01:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:01:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:01:49 user devstack@n-api.service[61717]: DEBUG oslo_concurrency.lockutils [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61717) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:01:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Creating event network-vif-plugged:3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b on user Apr 14 15:01:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.compute.server_external_events [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Creating event network-vif-deleted:3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b on user Apr 14 15:01:49 user devstack@n-api.service[61717]: INFO nova.api.openstack.requestlog [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031429 Apr 14 15:01:49 user devstack@n-api.service[61717]: [pid: 61717|app: 0|req: 391/1176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 15:01:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_api:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG dbcounter [-] [61716] Writing DB stats nova_cell1:SELECT=4 {{(pid=61716) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Calling method '>' {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG nova.compute.api [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Fetching instance by UUID {{(pid=61716) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "8e9f1617-03cf-4856-8f56-6b332827f1da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG oslo_concurrency.lockutils [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "8e9f1617-03cf-4856-8f56-6b332827f1da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61716) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 15:02:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.wsgi [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HTTP exception thrown: Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b could not be found. Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Request method failure captured: Apr 14 15:02:37 user devstack@n-api.service[61716]: request: GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b HTTP/1.1 Apr 14 15:02:37 user devstack@n-api.service[61716]: Accept: application/json Apr 14 15:02:37 user devstack@n-api.service[61716]: Accept-Encoding: identity Apr 14 15:02:37 user devstack@n-api.service[61716]: Connection: close Apr 14 15:02:37 user devstack@n-api.service[61716]: Content-Length: 0 Apr 14 15:02:37 user devstack@n-api.service[61716]: Content-Type: application/json Apr 14 15:02:37 user devstack@n-api.service[61716]: Host: 10.0.0.210 Apr 14 15:02:37 user devstack@n-api.service[61716]: Openstack-System-Scope: None Apr 14 15:02:37 user devstack@n-api.service[61716]: User-Agent: python-urllib3/1.26.15 Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Auth-Token: gAAAAABkOWZC_EmrvjTeC_YhxhgWYvFmp62fy4kbELMs3v0FkyqiTyX2XEoJ2cPcpG2QtwMB8Y3T5HBHEgh6yTRtE0DDIb91h3y8rKaUFXkat0OmvvUcSybHuHRflQblk8KZsMt897Yvy15bXRuOQC5H-JmmOjNBpyNRNayDyphbMloaBIMoHVM Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Domain-Id: None Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Domain-Name: None Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Identity-Status: Confirmed Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Is-Admin-Project: True Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Project-Domain-Id: default Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Project-Domain-Name: Default Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Project-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Role: member,reader Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Roles: member,reader Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2241300ad3704734aed3990cc7aadc1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Tenant-Id: 2241300ad3704734aed3990cc7aadc1b Apr 14 15:02:37 user devstack@n-api.service[61716]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649 Apr 14 15:02:37 user devstack@n-api.service[61716]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:02:37 user devstack@n-api.service[61716]: X-User-Domain-Id: default Apr 14 15:02:37 user devstack@n-api.service[61716]: X-User-Domain-Name: Default Apr 14 15:02:37 user devstack@n-api.service[61716]: X-User-Id: 2e321f85d3d44c2baf210a1962f4f08f Apr 14 15:02:37 user devstack@n-api.service[61716]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member Apr 14 15:02:37 user devstack@n-api.service[61716]: method: > Apr 14 15:02:37 user devstack@n-api.service[61716]: exception: Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b could not be found. Apr 14 15:02:37 user devstack@n-api.service[61716]: action_args: {'id': '2bf7382e-7ffd-4f89-8b79-e8616462c61b'} Apr 14 15:02:37 user devstack@n-api.service[61716]: {{(pid=61716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b could not be found. Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b could not be found. Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b could not be found. Apr 14 15:02:37 user devstack@n-api.service[61716]: ERROR nova.api.openstack.wsgi Apr 14 15:02:37 user devstack@n-api.service[61716]: DEBUG nova.api.openstack.wsgi [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Returning 404 to user: Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b could not be found. {{(pid=61716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 15:02:37 user devstack@n-api.service[61716]: INFO nova.api.openstack.requestlog [None req-cf97573b-9ad5-4b42-b54d-cb3e08b22f32 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b" status: 404 len: 111 microversion: 2.87 time: 0.037721 Apr 14 15:02:37 user devstack@n-api.service[61716]: [pid: 61716|app: 0|req: 395/1177] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 15:02:37 2023] GET /compute/v2.1/servers/2bf7382e-7ffd-4f89-8b79-e8616462c61b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0)